-- Logs begin at Thu 2022-08-25 23:49:26 UTC, end at Fri 2022-08-26 01:12:28 UTC. -- Aug 26 00:37:43.629451 dv-osbrick-786733-10-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 26 00:37:43.636864 dv-osbrick-786733-10-ceph devstack@keystone.service[95110]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 26 00:37:43.639685 dv-osbrick-786733-10-ceph devstack@keystone.service[95110]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 26 00:37:43 2022] *** Aug 26 00:37:43.639685 dv-osbrick-786733-10-ceph devstack@keystone.service[95110]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 26 00:37:43.639685 dv-osbrick-786733-10-ceph devstack@keystone.service[95110]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 26 00:37:43.639685 dv-osbrick-786733-10-ceph devstack@keystone.service[95110]: nodename: dv-osbrick-786733-10-ceph Aug 26 00:37:43.639685 dv-osbrick-786733-10-ceph devstack@keystone.service[95110]: machine: x86_64 Aug 26 00:37:43.639685 dv-osbrick-786733-10-ceph devstack@keystone.service[95110]: clock source: unix Aug 26 00:37:43.639685 dv-osbrick-786733-10-ceph devstack@keystone.service[95110]: pcre jit disabled Aug 26 00:37:43.639685 dv-osbrick-786733-10-ceph devstack@keystone.service[95110]: detected number of CPU cores: 4 Aug 26 00:37:43.639685 dv-osbrick-786733-10-ceph devstack@keystone.service[95110]: current working directory: / Aug 26 00:37:43.639685 dv-osbrick-786733-10-ceph devstack@keystone.service[95110]: detected binary path: /usr/bin/uwsgi-core Aug 26 00:37:43.640330 dv-osbrick-786733-10-ceph devstack@keystone.service[95110]: your processes number limit is 47680 Aug 26 00:37:43.640330 dv-osbrick-786733-10-ceph devstack@keystone.service[95110]: your memory page size is 4096 bytes Aug 26 00:37:43.640330 dv-osbrick-786733-10-ceph devstack@keystone.service[95110]: detected max file descriptor number: 2048 Aug 26 00:37:43.640330 dv-osbrick-786733-10-ceph devstack@keystone.service[95110]: lock engine: pthread robust mutexes Aug 26 00:37:43.640330 dv-osbrick-786733-10-ceph devstack@keystone.service[95110]: thunder lock: enabled Aug 26 00:37:43.640330 dv-osbrick-786733-10-ceph devstack@keystone.service[95110]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 26 00:37:43.640330 dv-osbrick-786733-10-ceph devstack@keystone.service[95110]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 26 00:37:43.685474 dv-osbrick-786733-10-ceph devstack@keystone.service[95110]: Python main interpreter initialized at 0x55a67f8fd9c0 Aug 26 00:37:43.685474 dv-osbrick-786733-10-ceph devstack@keystone.service[95110]: python threads support enabled Aug 26 00:37:43.685474 dv-osbrick-786733-10-ceph devstack@keystone.service[95110]: your server socket listen backlog is limited to 100 connections Aug 26 00:37:43.685474 dv-osbrick-786733-10-ceph devstack@keystone.service[95110]: your mercy for graceful operations on workers is 90 seconds Aug 26 00:37:43.685993 dv-osbrick-786733-10-ceph devstack@keystone.service[95110]: mapped 403077 bytes (393 KB) for 2 cores Aug 26 00:37:43.685993 dv-osbrick-786733-10-ceph devstack@keystone.service[95110]: *** Operational MODE: preforking *** Aug 26 00:37:43.686184 dv-osbrick-786733-10-ceph devstack@keystone.service[95110]: *** uWSGI is running in multiple interpreter mode *** Aug 26 00:37:43.686184 dv-osbrick-786733-10-ceph devstack@keystone.service[95110]: spawned uWSGI master process (pid: 95110) Aug 26 00:37:43.686435 dv-osbrick-786733-10-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 26 00:37:43.689240 dv-osbrick-786733-10-ceph devstack@keystone.service[95110]: spawned uWSGI worker 1 (pid: 95124, cores: 1) Aug 26 00:37:43.689240 dv-osbrick-786733-10-ceph devstack@keystone.service[95110]: spawned uWSGI worker 2 (pid: 95125, cores: 1) Aug 26 00:37:43.689240 dv-osbrick-786733-10-ceph devstack@keystone.service[95110]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 26 00:37:48.544442 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 00:37:48.544442 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: from cryptography.utils import int_from_bytes Aug 26 00:37:48.545321 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 00:37:48.545321 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: from cryptography.utils import int_from_bytes Aug 26 00:37:48.545797 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 00:37:48.545797 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: from cryptography.utils import int_from_bytes Aug 26 00:37:48.545943 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 00:37:48.545943 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: from cryptography.utils import int_from_bytes Aug 26 00:37:48.597842 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 00:37:48.598044 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 00:37:48.598210 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] command line args: [] {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 00:37:48.598479 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 00:37:48.598666 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ================================================================================ {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 00:37:48.598788 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 00:37:48.598912 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] admin_token = **** {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.598999 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 00:37:48.599126 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] command line args: [] {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 00:37:48.599217 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] config_dir = [] {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.599328 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.599410 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 00:37:48.599511 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] config_source = [] {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.599642 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ================================================================================ {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 00:37:48.599724 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] debug = True {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.599885 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] admin_token = **** {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.599982 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.601263 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] config_dir = [] {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.601330 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.601414 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.601477 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] insecure_debug = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.601549 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] config_source = [] {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.601615 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.601677 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] debug = True {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.601740 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.601803 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.601894 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] list_limit = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.601960 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.602018 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] log_config_append = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.602110 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] insecure_debug = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.602193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.602313 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.602435 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] log_dir = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.602435 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] log_file = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.602564 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.602627 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.602684 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] list_limit = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.602684 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] log_config_append = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.602795 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.602851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.602911 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.602973 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] log_dir = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.602973 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] log_file = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.603086 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.603086 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.603197 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.603258 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.603320 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.603382 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.603445 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.603507 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.603630 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.603698 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.603912 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.603995 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.604060 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.604149 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.604222 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.604383 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.604513 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.604620 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.604715 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.604863 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] notification_format = cadf {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.604966 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.605140 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.605259 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.605447 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.605638 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.605950 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.605950 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] publish_errors = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.606454 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] notification_format = cadf {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.606580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.606820 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.606998 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.606998 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] publish_errors = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.607239 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.607477 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.607660 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.607912 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.608152 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.608393 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] standard_threads = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.608602 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.608719 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] strict_password_check = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.608798 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.608879 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.609027 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] use_eventlog = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.609109 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.609208 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] use_journal = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.609284 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.609405 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] use_json = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.609570 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] standard_threads = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.609651 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] use_stderr = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.609755 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] use_syslog = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.609831 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] strict_password_check = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.609991 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] watch_log_file = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.610128 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.610220 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] use_eventlog = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.610296 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.610366 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] use_journal = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.610479 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.610552 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] use_json = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.610671 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] use_stderr = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.610760 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.610840 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] use_syslog = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.610963 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.611074 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] watch_log_file = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:37:48.611216 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.611336 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.611460 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.611578 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.611819 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.611916 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.612016 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.612094 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.612272 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.612357 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.612525 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.612608 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.612780 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.612864 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.613016 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.613099 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.613271 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.613422 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.613590 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.613678 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.613844 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.613922 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.614096 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.614178 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.614345 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.614422 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.614607 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.614685 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.614855 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.614931 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.615101 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.615183 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.615332 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.615404 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.615585 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.615671 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.615843 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.615932 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.616092 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.616169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.616332 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.616470 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.616551 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.616631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.616785 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.616862 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.617020 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.617136 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.617296 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.617483 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.617569 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.617651 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.617810 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.617919 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.618093 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.618237 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.618359 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.618480 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.618566 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.618627 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.618767 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.618851 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.618999 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.619160 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.619287 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.619449 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.619582 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.619715 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.619715 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.619949 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.620029 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.620198 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.620323 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.620455 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.620593 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.620723 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.620893 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.620976 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.621037 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.621106 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.621106 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.621224 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.621288 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.621462 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.621536 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.621832 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.622033 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.622172 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.622306 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.622440 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.622569 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.622652 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.622652 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.622797 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.622897 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.622983 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.623137 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.623205 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.623385 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.623456 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.623629 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.623697 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.623874 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.624027 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.624104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.624165 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.624346 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.624426 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.624577 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.624653 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.624819 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.624897 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.625061 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.625147 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.625300 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.625429 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.625561 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.625648 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.625817 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.625903 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.626057 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.626135 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.626290 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.626358 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.626521 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.626610 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.626760 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.626838 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.627015 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.627128 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.627433 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.627657 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.627740 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.627813 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.627930 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.628028 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.628123 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.628218 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.628297 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.628410 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.628497 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.628620 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.628844 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.628930 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] cache.enabled = True {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.629102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.629182 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.629341 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.629464 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.629607 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.629693 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.629849 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.629928 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] cache.enabled = True {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.630096 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.630173 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.630338 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.630416 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.630579 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.630665 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.630818 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.630906 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.631058 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.631134 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.631315 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.631456 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.631535 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.631756 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.631864 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.631996 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.632080 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.632259 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.632387 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.632550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.632659 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.632739 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.632908 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.633025 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.633164 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.633271 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.633438 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.633543 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.638100 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.638356 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.638501 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.638641 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.638791 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.638902 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.638979 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.639057 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.639129 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.639216 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.639489 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.639589 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.639685 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.639763 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.639890 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.639983 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.640056 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.640132 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.640208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.640279 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.640354 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.640432 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.640503 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.640562 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.640620 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.640721 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.640815 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.640900 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] auth.external = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.640966 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.641056 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] auth.mapped = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.641182 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.641259 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.641331 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.641331 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] auth.external = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.641526 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.641609 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] auth.mapped = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.641682 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] auth.password = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.641682 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] auth.token = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.641807 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.641877 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.641947 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.642026 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] catalog.caching = True {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.642103 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] auth.password = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.642173 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.642242 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] auth.token = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.642311 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.642380 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.642457 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.642529 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] catalog.caching = True {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.642598 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.642667 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.642770 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.642848 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.642957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] credential.caching = True {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.643035 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.643107 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] credential.driver = sql {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.643177 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.643247 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.643317 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.643463 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.643606 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] credential.caching = True {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.643682 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.643753 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] credential.driver = sql {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.643824 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.643894 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.644047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.644122 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.644194 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.644264 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.644334 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.644403 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.644485 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.644565 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.644637 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.644708 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.644777 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.644847 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.644972 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.645049 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.645109 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.645167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.645232 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.645297 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.645441 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.645509 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.645569 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] federation.caching = True {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.645626 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.645692 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.645795 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.645869 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] federation.driver = sql {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.645930 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.645988 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.646046 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] federation.caching = True {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.646103 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.646161 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.646228 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.646289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] federation.driver = sql {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.646347 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.646404 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.646462 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.646526 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.646585 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.646644 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.646747 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.646827 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.646953 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.647040 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.647206 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.647286 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.647447 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] identity.caching = True {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.647525 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.647698 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.647783 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.647947 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.648026 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.648181 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] identity.caching = True {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.648258 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.648418 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.648507 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.648913 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] identity.driver = sql {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.649030 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.649155 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.649234 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.649416 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.649512 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.649672 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] identity.driver = sql {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.649753 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.649907 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.649987 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.650148 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.650235 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.650384 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.650462 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.650621 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.650699 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.650865 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.650950 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.651257 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.651345 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.651497 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.652073 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.652307 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.652395 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.653158 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.653811 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.653977 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.654322 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.654405 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.654495 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.654618 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.654701 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.654774 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.654840 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.654925 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.655090 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.655171 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.655340 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.655427 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.655577 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.655656 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.655826 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.655915 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.656062 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.656148 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.656303 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.656426 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.656553 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.656634 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.656796 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.656875 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.657042 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.657119 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.657322 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.657748 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.658424 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.658516 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.658663 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.658757 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.659180 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.659281 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.659423 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.659524 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.password = **** {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.659675 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.659768 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.659911 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.659991 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.660154 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.660234 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.660389 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.password = **** {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.660480 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.660631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.660710 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.660873 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.660959 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.661130 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.661259 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.661387 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.661476 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.661630 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.661712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.661883 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.661978 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.662139 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.662235 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.662744 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.663179 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.663453 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.663547 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.663717 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.663796 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.663959 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.user = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.664047 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.664199 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.664332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.664456 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.664579 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.664707 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.664839 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.664971 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.user = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.665101 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.665237 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.665364 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.665519 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.665592 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.665662 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.665745 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.665853 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.665934 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.666105 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.666220 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.666355 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.666443 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.666592 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.666674 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.666823 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.666903 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.667064 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.667169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.667299 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.667385 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.667541 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.667649 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.667773 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.667868 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.668022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.668105 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.668271 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.668352 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.668522 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.668636 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.668837 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.669029 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.669111 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.669310 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.669434 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.674457 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.674545 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.674609 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.674669 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.674729 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.674787 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.674870 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.674934 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.675008 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.675081 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.675154 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.675227 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] policy.driver = sql {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.675304 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.675409 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.675486 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.675556 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.675615 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] policy.driver = sql {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.675686 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.675768 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.675842 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] receipt.caching = True {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.676188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.676251 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.676311 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.676370 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.676438 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] receipt.caching = True {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.676499 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.676558 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.676624 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.676685 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.676744 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.676810 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.676871 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] resource.caching = True {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.676930 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.676989 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.677048 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.677106 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] resource.driver = sql {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.677172 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] resource.caching = True {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.677233 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.677292 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.677351 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.677435 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] resource.driver = sql {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.677435 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.677556 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.677619 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.677684 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] revoke.caching = True {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.677744 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.677809 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.677877 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] revoke.caching = True {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.677938 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.677998 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.678057 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] role.cache_time = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.678151 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.678226 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] role.caching = True {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.678298 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] role.cache_time = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.678360 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] role.driver = sql {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.678420 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] role.caching = True {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.678479 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] role.list_limit = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.678539 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] role.driver = sql {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.678598 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.678663 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] role.list_limit = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.678724 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.678784 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.678843 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.678902 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.678962 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.679028 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.679028 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.679135 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.679200 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.679261 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.679319 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.679385 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.679446 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.679505 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.679565 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.679624 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.679682 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.679748 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.679809 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.679869 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.679953 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.680020 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.680080 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.680148 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.680229 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.680289 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.680347 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.680430 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.680496 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.680755 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.680835 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.680896 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.680955 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.681568 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.681665 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.681754 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.681830 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.681904 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.681976 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.682048 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.682129 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.682203 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.682275 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.682348 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.682420 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.682584 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.682683 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.682821 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.682907 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.683052 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.683132 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.683310 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.683397 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.683565 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.683646 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.683817 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.683896 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.684053 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.684141 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.684339 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.684428 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.684578 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] token.cache_time = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.684667 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] token.cache_time = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.684886 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] token.caching = True {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.684997 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] token.caching = True {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.685074 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.685146 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.685300 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] token.provider = fernet {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.685426 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] token.provider = fernet {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.685614 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.685719 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.685825 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.685896 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.686073 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.686187 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.686310 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.686405 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.686557 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.686645 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.686801 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.686881 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.687051 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] trust.driver = sql {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.687148 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] trust.driver = sql {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.687292 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.687370 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.687530 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.687608 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.687765 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.687853 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.688019 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.688120 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.688296 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.688376 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.688527 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.688621 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.688768 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.688857 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.689037 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.689120 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.689298 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] database.connection = **** {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.689408 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] database.connection = **** {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.689571 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.689652 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.689819 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.689901 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.690060 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.690139 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.690300 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.690381 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.690536 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.690617 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.690771 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.690850 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.691009 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.691088 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.691244 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.691326 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.691622 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.691747 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.691826 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.691887 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.692023 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.692107 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.692261 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.692343 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.692514 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.692602 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.692751 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.692980 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.693070 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.693146 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.693218 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.693290 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.693475 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.693562 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.693713 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.693795 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:37:48.693887 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=95125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 00:37:48.693967 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=95124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 00:37:48.725348 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=95124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.725595 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=95124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.725730 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=95125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.725865 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=95124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.726063 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=95125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.726266 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=95125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.734882 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=95124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.735411 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=95125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.764398 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=95124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.766533 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=95124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.766661 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=95125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.766661 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=95125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.821017 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=95124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.822526 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=95125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.870626 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=95124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.870850 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=95124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.872892 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=95125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.873130 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=95125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.944232 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=95124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.944468 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=95124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.944693 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=95124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.944913 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=95124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.945225 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=95124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.945323 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=95125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.945440 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=95124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.945534 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=95125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.945663 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=95125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.945892 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=95125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.946113 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=95125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.946335 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=95125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.970382 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=95124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.970614 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=95124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.970710 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=95125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.970846 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=95124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.970946 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=95125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.971070 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=95124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.971158 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=95125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.971286 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=95124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.971371 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=95125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.971498 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=95124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.971595 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=95125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.971710 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=95124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.971964 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=95125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.972120 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=95125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.983541 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=95124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:48.984134 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=95125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:49.002448 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=95125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:49.002616 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=95124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:49.002708 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=95125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:49.002786 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=95124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:49.002867 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=95125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:49.002968 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=95124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:49.003085 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=95125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:49.003179 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=95124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:49.003303 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=95125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:49.003386 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=95124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:49.003542 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=95125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:49.003636 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=95124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:49.003755 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=95125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:49.003905 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=95124) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:37:49.027148 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.027327 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.027327 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 00:37:49.027510 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 00:37:49.027688 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.027786 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.027886 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 00:37:49.027979 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 00:37:49.028198 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.028296 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.028500 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.028652 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.028771 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.028913 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.029068 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.029226 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.038983 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.039277 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.039375 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.039551 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.039637 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.039841 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.039927 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.040157 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.047316 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=95124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.047738 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=95125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.050416 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=95124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.050704 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.050795 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=95125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.051244 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.051333 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.051569 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.051652 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.051858 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.051951 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.052123 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.052206 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.052398 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.052478 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.052661 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.052749 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.052934 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.053015 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.053205 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.053285 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.053503 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.053590 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.053770 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.078215 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.078811 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.079680 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=95124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.079971 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.080285 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=95125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.080568 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.084624 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=95124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.084900 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.085119 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=95125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.085424 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.086980 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.087465 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.093875 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=95124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.094173 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.094570 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=95125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.094859 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.098286 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=95124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.098593 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.098899 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.099008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=95125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.099293 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.099387 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.099573 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.099656 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.099871 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.100004 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.100164 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.100250 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.100447 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.100552 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.100819 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.101098 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.117084 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.117392 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.117884 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.118163 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.121461 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=95124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.123242 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=95125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.125234 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.125675 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.126413 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.126866 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.130062 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=95124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.131205 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=95125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.133231 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=95124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.134348 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=95125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.136477 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.136778 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.137073 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.137557 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.137748 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.137836 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.138163 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.138250 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.138520 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.138920 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.139240 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.139511 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.154393 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=95124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.162426 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.162426 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.162426 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.162631 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=95125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.162631 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.162631 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.162631 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.163004 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.163937 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.164731 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.165027 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.165598 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.165876 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.167830 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=95124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.168122 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.168414 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.168511 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=95125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.169429 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.169518 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.169792 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.169967 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.170250 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.170528 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.181865 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=95124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.182158 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.182445 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.182574 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=95125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.182733 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.182818 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.183021 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.183106 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.183372 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.183485 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.183592 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.183676 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.183886 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.184181 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.200935 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=95124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.202553 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=95125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.204128 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=95124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.204505 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=95125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.207228 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.207576 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.208726 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.209012 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.210304 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=95124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.210592 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.210696 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=95125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.210882 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.210968 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.211162 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.218014 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.218335 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.219554 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=95124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.219853 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=95125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.222569 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.222843 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.222928 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.223135 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.223220 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.223421 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.223503 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.223697 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.232134 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=95124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.232430 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.232514 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=95125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.232884 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.233090 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.236900 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.239934 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=95124) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.240630 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=95125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:37:49.241448 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.241750 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.242063 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.242175 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.242388 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.242486 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.242665 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.242751 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.242988 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.243072 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.243294 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.243376 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.243613 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.243773 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.243956 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.244075 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.244280 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.244372 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.244544 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.244641 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.244816 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.244900 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.245088 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.245172 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=95124) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.245538 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.245809 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=95125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:37:49.280425 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a67f8fd9c0 pid: 95124 (default app) Aug 26 00:37:49.281804 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a67f8fd9c0 pid: 95125 (default app) Aug 26 00:37:49.284059 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c64cd-1072-4d6b-b431-85e7e014a034 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:37:49.284349 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c64cd-1072-4d6b-b431-85e7e014a034 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:37:49.284667 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c64cd-1072-4d6b-b431-85e7e014a034 None None] PATH_INFO: `/v3` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:37:49.288853 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Fri Aug 26 00:37:49 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:37:57.794195 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a265e-738c-4416-9b83-6b1f6e0658fb None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:37:57.794718 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a265e-738c-4416-9b83-6b1f6e0658fb None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:37:57.794823 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a265e-738c-4416-9b83-6b1f6e0658fb None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:37:57.799713 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:37:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:37:57.805611 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece1f5b-bb1c-4c67-8a90-e4ee4f159c58 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:37:57.806059 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece1f5b-bb1c-4c67-8a90-e4ee4f159c58 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:37:57.806171 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece1f5b-bb1c-4c67-8a90-e4ee4f159c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:37:57.883752 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: INFO dbcounter [None req-cece1f5b-bb1c-4c67-8a90-e4ee4f159c58 None None] Registered counter for database keystone Aug 26 00:37:57.905625 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG oslo_db.sqlalchemy.engines [None req-cece1f5b-bb1c-4c67-8a90-e4ee4f159c58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=95124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 00:37:57.912445 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writer thread running {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 00:37:58.097307 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG passlib.handlers.bcrypt [None req-cece1f5b-bb1c-4c67-8a90-e4ee4f159c58 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=95124) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 26 00:37:58.097703 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG passlib.handlers.bcrypt [None req-cece1f5b-bb1c-4c67-8a90-e4ee4f159c58 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=95124) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 26 00:37:58.153534 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-cece1f5b-bb1c-4c67-8a90-e4ee4f159c58 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:37:58.155268 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-cece1f5b-bb1c-4c67-8a90-e4ee4f159c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:37:58.290169 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:37:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 486 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 26 00:37:58.836166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a265e-738c-4416-9b83-6b1f6e0658fb None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:37:58.915354 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: INFO dbcounter [None req-8d0a265e-738c-4416-9b83-6b1f6e0658fb None None] Registered counter for database keystone Aug 26 00:37:58.936560 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG oslo_db.sqlalchemy.engines [None req-8d0a265e-738c-4416-9b83-6b1f6e0658fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=95125) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 00:37:58.943117 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writer thread running {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 00:37:59.065591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a265e-738c-4416-9b83-6b1f6e0658fb None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:37:59.070058 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28973ba-34c6-408d-9c49-ff838d2a9288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:37:59.070704 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28973ba-34c6-408d-9c49-ff838d2a9288 admin admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:37:59.070993 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28973ba-34c6-408d-9c49-ff838d2a9288 admin admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:37:59.071271 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28973ba-34c6-408d-9c49-ff838d2a9288 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:37:59.079947 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28973ba-34c6-408d-9c49-ff838d2a9288 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:37:59.133206 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c28973ba-34c6-408d-9c49-ff838d2a9288 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 26 00:37:59.133515 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28973ba-34c6-408d-9c49-ff838d2a9288 admin admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:37:59.143776 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Fri Aug 26 00:37:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 00:37:59.149936 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece1f5b-bb1c-4c67-8a90-e4ee4f159c58 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:37:59.165043 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece1f5b-bb1c-4c67-8a90-e4ee4f159c58 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:37:59.170387 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccf539-f631-44de-8673-e24e79bb86a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:37:59.171505 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccf539-f631-44de-8673-e24e79bb86a6 admin admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:37:59.171792 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccf539-f631-44de-8673-e24e79bb86a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:37:59.172069 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccf539-f631-44de-8673-e24e79bb86a6 admin admin] PATH_INFO: `/v3/projects/d490d60fce834824a5c1595cbd7a1ebe` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:37:59.176169 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eccf539-f631-44de-8673-e24e79bb86a6 admin admin] RBAC: Authorizing `identity:get_project(project_id=d490d60fce834824a5c1595cbd7a1ebe)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:37:59.226732 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9eccf539-f631-44de-8673-e24e79bb86a6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 26 00:37:59.236059 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eccf539-f631-44de-8673-e24e79bb86a6 admin admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:37:59.236059 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Fri Aug 26 00:37:59 2022] GET /identity/v3/projects/d490d60fce834824a5c1595cbd7a1ebe => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:01.438355 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6fcb0-1fdc-4406-848e-5927462a291f None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:01.438866 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6fcb0-1fdc-4406-848e-5927462a291f None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:01.438979 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6fcb0-1fdc-4406-848e-5927462a291f None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:01.443008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:01.448620 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33018d-862a-46bf-8c77-51ed1609e471 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:01.449031 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33018d-862a-46bf-8c77-51ed1609e471 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:01.449193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33018d-862a-46bf-8c77-51ed1609e471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:01.470262 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-bf33018d-862a-46bf-8c77-51ed1609e471 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:01.471821 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-bf33018d-862a-46bf-8c77-51ed1609e471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:01.479825 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 26 00:38:01.803862 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6fcb0-1fdc-4406-848e-5927462a291f None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:01.817495 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6fcb0-1fdc-4406-848e-5927462a291f None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:01.821902 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b204aa-3e4f-4526-a5b8-cff089b47388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:01.822685 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b204aa-3e4f-4526-a5b8-cff089b47388 admin admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:01.822969 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b204aa-3e4f-4526-a5b8-cff089b47388 admin admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:01.823246 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b204aa-3e4f-4526-a5b8-cff089b47388 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:01.831931 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b204aa-3e4f-4526-a5b8-cff089b47388 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:01.833760 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b204aa-3e4f-4526-a5b8-cff089b47388 admin admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:01.842993 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Fri Aug 26 00:38:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 00:38:01.848639 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33018d-862a-46bf-8c77-51ed1609e471 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:01.858552 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33018d-862a-46bf-8c77-51ed1609e471 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:01.862957 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66048b5f-8dd3-43d9-adda-4e67e2632638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:01.863583 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66048b5f-8dd3-43d9-adda-4e67e2632638 admin admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:01.863867 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66048b5f-8dd3-43d9-adda-4e67e2632638 admin admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:01.864142 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66048b5f-8dd3-43d9-adda-4e67e2632638 admin admin] PATH_INFO: `/v3/users/a681f7ed1c9344b28a9297878afcbf46` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:01.865481 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66048b5f-8dd3-43d9-adda-4e67e2632638 admin admin] RBAC: Authorizing `identity:get_user(user_id=a681f7ed1c9344b28a9297878afcbf46)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:01.867316 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66048b5f-8dd3-43d9-adda-4e67e2632638 admin admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:01.868847 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Fri Aug 26 00:38:01 2022] GET /identity/v3/users/a681f7ed1c9344b28a9297878afcbf46 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:04.153425 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d543b00-1819-4273-bcbd-127b9a8ff7a5 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:04.154083 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d543b00-1819-4273-bcbd-127b9a8ff7a5 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:04.154083 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d543b00-1819-4273-bcbd-127b9a8ff7a5 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:04.155386 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:38:04.160990 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ad648-260f-42de-8766-9809ab9facf3 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:04.161484 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ad648-260f-42de-8766-9809ab9facf3 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:04.161571 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ad648-260f-42de-8766-9809ab9facf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:04.180733 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-e63ad648-260f-42de-8766-9809ab9facf3 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:04.182023 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-e63ad648-260f-42de-8766-9809ab9facf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:04.195952 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36eb84a-1787-4dbd-862f-dbe6fc9607b7 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:04.196286 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36eb84a-1787-4dbd-862f-dbe6fc9607b7 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:04.196575 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36eb84a-1787-4dbd-862f-dbe6fc9607b7 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:04.198491 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:38:04.204561 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e431a87-b4b0-43c4-a3c7-2a1c998882c4 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:04.204853 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e431a87-b4b0-43c4-a3c7-2a1c998882c4 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:04.205135 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e431a87-b4b0-43c4-a3c7-2a1c998882c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:04.249653 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG passlib.handlers.bcrypt [None req-0e431a87-b4b0-43c4-a3c7-2a1c998882c4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=95125) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 26 00:38:04.250092 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG passlib.handlers.bcrypt [None req-0e431a87-b4b0-43c4-a3c7-2a1c998882c4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=95125) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 26 00:38:04.269440 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:04.296364 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-0e431a87-b4b0-43c4-a3c7-2a1c998882c4 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:04.298062 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-0e431a87-b4b0-43c4-a3c7-2a1c998882c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:04.406875 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:38:04.602929 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ad648-260f-42de-8766-9809ab9facf3 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:04.628114 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:04.739668 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e431a87-b4b0-43c4-a3c7-2a1c998882c4 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:04.840775 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ad648-260f-42de-8766-9809ab9facf3 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:04.864430 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e431a87-b4b0-43c4-a3c7-2a1c998882c4 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:04.866820 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:04.879104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47b4d6-353e-4038-bbb4-d1db67758643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:04.879758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47b4d6-353e-4038-bbb4-d1db67758643 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:04.880044 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47b4d6-353e-4038-bbb4-d1db67758643 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:04.880383 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47b4d6-353e-4038-bbb4-d1db67758643 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:04.894190 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a47b4d6-353e-4038-bbb4-d1db67758643 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:38:04.903631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-4a47b4d6-353e-4038-bbb4-d1db67758643 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:38:04.903631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:04.903631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:04.903631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:04.903631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:04.903631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:04.903631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:04.903631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:04.903631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:04.903631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:04.903631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:04.903631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:04.903631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:38:04.903631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:38:04.903631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:38:04.903631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:38:04.904670 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:38:04.904670 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:38:04.904670 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:38:04.904670 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:38:04.904670 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:04.904670 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:04.904670 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:04.904670 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:04.904670 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:04.904670 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:04.904670 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:04.904670 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:04.904670 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:04.904670 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:04.904670 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:04.904670 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:04.905553 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:04.905553 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:04.905553 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:04.905553 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:04.905553 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:38:04.905553 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:38:04.905553 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:38:04.905553 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:38:04.905553 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:38:04.905553 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:38:04.905553 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:38:04.905553 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:38:04.905553 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 00:38:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:38:04.910989 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe4f65-53d2-450f-b264-dccba44c10f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:04.912040 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe4f65-53d2-450f-b264-dccba44c10f4 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:04.912246 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe4f65-53d2-450f-b264-dccba44c10f4 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:04.913190 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe4f65-53d2-450f-b264-dccba44c10f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:04.914773 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47b4d6-353e-4038-bbb4-d1db67758643 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:04.998471 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe4f65-53d2-450f-b264-dccba44c10f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:04.999647 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe4f65-53d2-450f-b264-dccba44c10f4 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:05.015413 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:05.034038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47b4d6-353e-4038-bbb4-d1db67758643 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:05.071049 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f18e3d-cc7a-4e8e-b22e-d96426c77b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:05.071741 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f18e3d-cc7a-4e8e-b22e-d96426c77b65 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:05.072028 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f18e3d-cc7a-4e8e-b22e-d96426c77b65 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:05.072313 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f18e3d-cc7a-4e8e-b22e-d96426c77b65 None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:05.073002 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f18e3d-cc7a-4e8e-b22e-d96426c77b65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:05.073348 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f18e3d-cc7a-4e8e-b22e-d96426c77b65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:05.075344 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f18e3d-cc7a-4e8e-b22e-d96426c77b65 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:05.087546 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 8/15] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:38:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:38:05.093796 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f18e3d-cc7a-4e8e-b22e-d96426c77b65 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:05.106872 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:38:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 00:38:05.112574 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe4f65-53d2-450f-b264-dccba44c10f4 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:05.116941 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:05.203963 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f18e3d-cc7a-4e8e-b22e-d96426c77b65 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:05.220216 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe4f65-53d2-450f-b264-dccba44c10f4 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:05.241927 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3a400-2bdd-467b-9599-42d70f264260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:05.242535 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3a400-2bdd-467b-9599-42d70f264260 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:05.242815 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3a400-2bdd-467b-9599-42d70f264260 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:05.243098 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3a400-2bdd-467b-9599-42d70f264260 None admin] PATH_INFO: `/v3/users/a681f7ed1c9344b28a9297878afcbf46` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:05.244252 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3a400-2bdd-467b-9599-42d70f264260 None admin] RBAC: Authorizing `identity:get_user(user_id=a681f7ed1c9344b28a9297878afcbf46)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:05.245787 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3a400-2bdd-467b-9599-42d70f264260 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:05.248377 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:38:05 2022] GET /identity/v3/users/a681f7ed1c9344b28a9297878afcbf46 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:38:05.254016 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3a400-2bdd-467b-9599-42d70f264260 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:05.255726 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3efeb-f062-444c-afd9-d32e65247a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:05.256584 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3efeb-f062-444c-afd9-d32e65247a3f None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:05.256861 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3efeb-f062-444c-afd9-d32e65247a3f None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:05.257133 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3efeb-f062-444c-afd9-d32e65247a3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:05.269598 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:05.276126 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3efeb-f062-444c-afd9-d32e65247a3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:05.278584 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3efeb-f062-444c-afd9-d32e65247a3f None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:05.297631 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-88d3efeb-f062-444c-afd9-d32e65247a3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:38:05.297631 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:05.297631 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:05.297631 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:05.297631 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:05.297631 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:05.297631 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:05.297631 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:05.297631 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:05.297631 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:05.297631 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:05.297631 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:05.297631 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:38:05.297631 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:38:05.297631 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:38:05.297631 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:38:05.299591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:05.299591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:05.299591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:05.299591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:05.299591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:05.299591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:05.299591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:05.299591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:05.299591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:05.299591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:05.299591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:05.299591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:05.299591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:05.299591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:05.299591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:05.299591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:05.299591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:38:05.301063 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:38:05.301063 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:38:05.301063 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:38:05.301063 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 9/18] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:38:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:38:05.304909 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3efeb-f062-444c-afd9-d32e65247a3f None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:05.363389 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3a400-2bdd-467b-9599-42d70f264260 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:05.370246 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:05.401940 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64795df3-3165-464a-978c-bae22841e842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:05.403133 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64795df3-3165-464a-978c-bae22841e842 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:05.403471 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64795df3-3165-464a-978c-bae22841e842 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:05.403759 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64795df3-3165-464a-978c-bae22841e842 None admin] PATH_INFO: `/v3/domains/default` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:05.405015 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64795df3-3165-464a-978c-bae22841e842 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:05.406590 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64795df3-3165-464a-978c-bae22841e842 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:05.408240 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 10/19] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:38:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:38:05.414396 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64795df3-3165-464a-978c-bae22841e842 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:05.509069 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:05.530624 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64795df3-3165-464a-978c-bae22841e842 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:05.538527 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3efeb-f062-444c-afd9-d32e65247a3f None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:05.567988 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3feb85-a425-4185-95bd-2c1d05b7f28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:05.568602 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3feb85-a425-4185-95bd-2c1d05b7f28a None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:05.568886 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3feb85-a425-4185-95bd-2c1d05b7f28a None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:05.569164 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3feb85-a425-4185-95bd-2c1d05b7f28a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:05.569970 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3feb85-a425-4185-95bd-2c1d05b7f28a None admin] RBAC: Adding query filter params (role.id=f13055bcebf847bf8b46160ded13810b, scope.domain.id=default, user.id=a681f7ed1c9344b28a9297878afcbf46) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:05.570287 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3feb85-a425-4185-95bd-2c1d05b7f28a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:05.571744 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3feb85-a425-4185-95bd-2c1d05b7f28a None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:05.579380 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 11/20] 10.222.0.20 () {56 vars in 1322 bytes} [Fri Aug 26 00:38:05 2022] GET /identity/v3/role_assignments?user.id=a681f7ed1c9344b28a9297878afcbf46&scope.domain.id=default&role.id=f13055bcebf847bf8b46160ded13810b => generated 233 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:38:05.582353 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5bf1c-60e3-4074-bb3a-c760b08a36db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:05.583386 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5bf1c-60e3-4074-bb3a-c760b08a36db None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:05.583891 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5bf1c-60e3-4074-bb3a-c760b08a36db None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:05.584377 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5bf1c-60e3-4074-bb3a-c760b08a36db None admin] PATH_INFO: `/v3/domains` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:05.585631 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a5bf1c-60e3-4074-bb3a-c760b08a36db None admin] RBAC: Adding query filter params (name=Default) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:05.586473 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a5bf1c-60e3-4074-bb3a-c760b08a36db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:05.589196 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a5bf1c-60e3-4074-bb3a-c760b08a36db None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:05.616000 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 10/21] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:38:08.565437 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841527f-a512-4a9c-8de3-0d2e5aa92d09 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:08.566219 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841527f-a512-4a9c-8de3-0d2e5aa92d09 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:08.566219 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841527f-a512-4a9c-8de3-0d2e5aa92d09 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:08.567378 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 12/22] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:08.587131 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3bdc1-f859-48de-92a4-262519d3cbdd None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:08.587131 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3bdc1-f859-48de-92a4-262519d3cbdd None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:08.587131 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3bdc1-f859-48de-92a4-262519d3cbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:08.612016 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-8ec3bdc1-f859-48de-92a4-262519d3cbdd None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:08.614028 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-8ec3bdc1-f859-48de-92a4-262519d3cbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:08.685308 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81690d6-692f-4752-b290-9c190d7435e8 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:08.685620 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81690d6-692f-4752-b290-9c190d7435e8 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:08.685908 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81690d6-692f-4752-b290-9c190d7435e8 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:08.687590 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 13/23] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:08.694272 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55003a02-8f24-4e3f-b4b6-b3cc6a4fe214 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:08.694570 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55003a02-8f24-4e3f-b4b6-b3cc6a4fe214 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:08.694857 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55003a02-8f24-4e3f-b4b6-b3cc6a4fe214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:08.734775 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-55003a02-8f24-4e3f-b4b6-b3cc6a4fe214 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:08.736258 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-55003a02-8f24-4e3f-b4b6-b3cc6a4fe214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:08.752532 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 11/24] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:08.874521 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 14/25] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:08.916462 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249c4c1-a613-42d4-ae86-fbd33f87a856 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:08.917358 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249c4c1-a613-42d4-ae86-fbd33f87a856 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:08.917889 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249c4c1-a613-42d4-ae86-fbd33f87a856 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:08.919938 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a7036-f41f-40df-b4a7-f85655741f16 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:08.921780 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a7036-f41f-40df-b4a7-f85655741f16 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:08.921780 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a7036-f41f-40df-b4a7-f85655741f16 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:08.922212 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 15/27] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:08.922396 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 12/27] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:08.927299 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d233a02-e275-4b2b-b12e-ee1e8602f37f None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:08.927592 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d233a02-e275-4b2b-b12e-ee1e8602f37f None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:08.927879 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d233a02-e275-4b2b-b12e-ee1e8602f37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:08.929776 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bd247-eed6-4055-9fae-2c5a2e704123 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:08.930279 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bd247-eed6-4055-9fae-2c5a2e704123 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:08.930846 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bd247-eed6-4055-9fae-2c5a2e704123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:08.962982 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-5d233a02-e275-4b2b-b12e-ee1e8602f37f None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:08.965512 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-5d233a02-e275-4b2b-b12e-ee1e8602f37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:08.970434 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-887bd247-eed6-4055-9fae-2c5a2e704123 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:08.972109 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-887bd247-eed6-4055-9fae-2c5a2e704123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:09.076256 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:09.127920 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 16/28] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:09.135486 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 13/29] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:38:09.253182 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d233a02-e275-4b2b-b12e-ee1e8602f37f None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:09.256873 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:09.379902 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d233a02-e275-4b2b-b12e-ee1e8602f37f None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:09.420092 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c14677-df77-449e-b86c-393e26dc3f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:09.420778 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c14677-df77-449e-b86c-393e26dc3f3d None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:09.421068 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c14677-df77-449e-b86c-393e26dc3f3d None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:09.421346 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c14677-df77-449e-b86c-393e26dc3f3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:09.432523 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c14677-df77-449e-b86c-393e26dc3f3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:09.434096 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c14677-df77-449e-b86c-393e26dc3f3d None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:09.451248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-c7c14677-df77-449e-b86c-393e26dc3f3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:38:09.451248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:09.451248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:09.451248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:09.451248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:09.451248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:09.451248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:09.451248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:09.451248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:09.451248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:09.451248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:09.451248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:09.451248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:38:09.451248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:38:09.451248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:38:09.451248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:38:09.452161 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:09.452161 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:09.452161 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:09.452161 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:09.452161 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:09.452161 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:09.452161 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:09.452161 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:09.452161 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:09.452161 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:09.452161 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:09.452161 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:09.452161 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:09.452161 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:09.452161 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:09.452161 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:09.452161 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:38:09.452960 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:38:09.452960 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:38:09.452960 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:38:09.452960 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 17/30] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:38:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:38:09.462799 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887bd247-eed6-4055-9fae-2c5a2e704123 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:09.585004 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c14677-df77-449e-b86c-393e26dc3f3d None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:09.626822 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887bd247-eed6-4055-9fae-2c5a2e704123 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:09.685059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdbe91-c9c2-4743-a747-0c46153b7343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:09.686142 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdbe91-c9c2-4743-a747-0c46153b7343 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:09.686651 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdbe91-c9c2-4743-a747-0c46153b7343 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:09.687156 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdbe91-c9c2-4743-a747-0c46153b7343 None admin] PATH_INFO: `/v3/domains` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:09.688403 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fdbe91-c9c2-4743-a747-0c46153b7343 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:09.688972 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fdbe91-c9c2-4743-a747-0c46153b7343 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:09.691026 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fdbe91-c9c2-4743-a747-0c46153b7343 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:09.719124 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 14/31] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:09.723179 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdbe91-c9c2-4743-a747-0c46153b7343 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:09.738588 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:09.767925 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:09.828785 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c14677-df77-449e-b86c-393e26dc3f3d None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:09.848278 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdbe91-c9c2-4743-a747-0c46153b7343 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:09.879038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac39d87-2f57-409a-b6a0-f1e3ea93be8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:09.879680 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac39d87-2f57-409a-b6a0-f1e3ea93be8c None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:09.880012 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac39d87-2f57-409a-b6a0-f1e3ea93be8c None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:09.880293 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac39d87-2f57-409a-b6a0-f1e3ea93be8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:09.887944 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692df08-3a36-4dd5-8011-834b39f88bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:09.888856 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692df08-3a36-4dd5-8011-834b39f88bc9 None admin] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:09.889399 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692df08-3a36-4dd5-8011-834b39f88bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:09.889882 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692df08-3a36-4dd5-8011-834b39f88bc9 None admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:09.890755 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692df08-3a36-4dd5-8011-834b39f88bc9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:09.892280 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac39d87-2f57-409a-b6a0-f1e3ea93be8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:38:09.892566 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692df08-3a36-4dd5-8011-834b39f88bc9 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:09.898647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-7ac39d87-2f57-409a-b6a0-f1e3ea93be8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:38:09.898647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:09.898647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:09.898647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:09.898647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:09.898647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:09.898647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:09.898647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:09.898647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:09.898647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:09.898647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:09.898647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:09.898647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:38:09.898647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:38:09.898647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:38:09.898647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:38:09.899515 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:38:09.899515 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:38:09.899515 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:38:09.899515 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:38:09.899515 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:09.899515 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:09.899515 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:09.899515 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:09.899515 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:09.899515 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:09.899515 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:09.899515 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:09.899515 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:09.899515 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:09.899515 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:09.899515 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:09.900265 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:09.900265 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:09.900265 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:09.900265 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:09.900265 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:38:09.900265 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:38:09.900265 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:38:09.900265 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:38:09.900265 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:38:09.900265 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:38:09.900265 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:38:09.900265 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:38:09.900265 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 18/32] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 00:38:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:38:09.900874 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac39d87-2f57-409a-b6a0-f1e3ea93be8c None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:10.032565 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac39d87-2f57-409a-b6a0-f1e3ea93be8c None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:10.054014 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:10.075445 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd76a9-d6b6-4e5d-807e-6e465c2ccf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:10.076396 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd76a9-d6b6-4e5d-807e-6e465c2ccf5b None admin] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:10.076852 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd76a9-d6b6-4e5d-807e-6e465c2ccf5b None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:10.077277 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd76a9-d6b6-4e5d-807e-6e465c2ccf5b None admin] PATH_INFO: `/v3/projects` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:10.078132 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd76a9-d6b6-4e5d-807e-6e465c2ccf5b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:10.079866 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd76a9-d6b6-4e5d-807e-6e465c2ccf5b None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:10.140604 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 15/33] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Aug 26 00:38:09 2022] POST /identity/v3/roles => generated 219 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:10.140604 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692df08-3a36-4dd5-8011-834b39f88bc9 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:10.255933 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:10.265460 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692df08-3a36-4dd5-8011-834b39f88bc9 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:10.314397 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60f175-b337-4c07-ab96-c1129239a439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:10.315164 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60f175-b337-4c07-ab96-c1129239a439 None admin] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:10.315517 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60f175-b337-4c07-ab96-c1129239a439 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:10.315807 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60f175-b337-4c07-ab96-c1129239a439 None admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:10.316574 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60f175-b337-4c07-ab96-c1129239a439 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:10.318260 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60f175-b337-4c07-ab96-c1129239a439 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:10.409824 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 19/34] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 26 00:38:09 2022] POST /identity/v3/projects => generated 301 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:10.411200 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd76a9-d6b6-4e5d-807e-6e465c2ccf5b None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:10.429772 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 16/35] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Aug 26 00:38:10 2022] POST /identity/v3/roles => generated 225 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:10.430518 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b100c12-03aa-4bbd-bc97-16d9bac9de15 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:10.430813 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b100c12-03aa-4bbd-bc97-16d9bac9de15 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:10.431088 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b100c12-03aa-4bbd-bc97-16d9bac9de15 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:10.432415 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 17/36] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:10.433650 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1de42-83c8-4291-9d2e-6137955006a3 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:10.434110 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1de42-83c8-4291-9d2e-6137955006a3 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:10.434494 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1de42-83c8-4291-9d2e-6137955006a3 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:10.436712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 18/37] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:10.443156 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0d266-86b5-4a2b-ab91-106c0e5f2a88 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:10.443156 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0d266-86b5-4a2b-ab91-106c0e5f2a88 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:10.443156 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0d266-86b5-4a2b-ab91-106c0e5f2a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:10.466738 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-b0e0d266-86b5-4a2b-ab91-106c0e5f2a88 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:10.468426 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-b0e0d266-86b5-4a2b-ab91-106c0e5f2a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:10.570130 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 19/38] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:10.571411 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb1a41-6ed6-4a58-bd4a-0f3c51997184 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:10.571700 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb1a41-6ed6-4a58-bd4a-0f3c51997184 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:10.571979 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb1a41-6ed6-4a58-bd4a-0f3c51997184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:10.584053 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd76a9-d6b6-4e5d-807e-6e465c2ccf5b None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:10.602518 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-e1eb1a41-6ed6-4a58-bd4a-0f3c51997184 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:10.603890 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-e1eb1a41-6ed6-4a58-bd4a-0f3c51997184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:10.657527 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39dee3-a3d3-498a-9e94-4ce1c3cd2526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:10.658300 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39dee3-a3d3-498a-9e94-4ce1c3cd2526 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:10.658691 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39dee3-a3d3-498a-9e94-4ce1c3cd2526 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:10.659064 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39dee3-a3d3-498a-9e94-4ce1c3cd2526 None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:10.659854 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb39dee3-a3d3-498a-9e94-4ce1c3cd2526 None admin] RBAC: Adding query filter params (name=admin) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:10.660167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb39dee3-a3d3-498a-9e94-4ce1c3cd2526 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:10.661823 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb39dee3-a3d3-498a-9e94-4ce1c3cd2526 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:10.672700 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 20/39] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:38:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:10.678475 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39dee3-a3d3-498a-9e94-4ce1c3cd2526 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:10.717930 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 20/40] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:10.719002 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:10.817334 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39dee3-a3d3-498a-9e94-4ce1c3cd2526 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:10.852674 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e4fdc-7b2e-4610-b6d4-0ae5e92c8749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:10.853239 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e4fdc-7b2e-4610-b6d4-0ae5e92c8749 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:10.853558 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e4fdc-7b2e-4610-b6d4-0ae5e92c8749 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:10.853839 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e4fdc-7b2e-4610-b6d4-0ae5e92c8749 None admin] PATH_INFO: `/v3/users/a681f7ed1c9344b28a9297878afcbf46` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:10.855112 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e4fdc-7b2e-4610-b6d4-0ae5e92c8749 None admin] RBAC: Authorizing `identity:get_user(user_id=a681f7ed1c9344b28a9297878afcbf46)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:10.858298 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e4fdc-7b2e-4610-b6d4-0ae5e92c8749 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:10.861304 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 21/41] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:38:10 2022] GET /identity/v3/users/a681f7ed1c9344b28a9297878afcbf46 => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:38:10.866567 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb1a41-6ed6-4a58-bd4a-0f3c51997184 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:10.893279 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:10.966156 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e4fdc-7b2e-4610-b6d4-0ae5e92c8749 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:11.001115 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb1a41-6ed6-4a58-bd4a-0f3c51997184 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:11.047923 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef242fa-c40e-4c51-ab1d-52f1cddd668d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:11.048679 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef242fa-c40e-4c51-ab1d-52f1cddd668d None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:11.049026 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef242fa-c40e-4c51-ab1d-52f1cddd668d None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:11.049396 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef242fa-c40e-4c51-ab1d-52f1cddd668d None admin] PATH_INFO: `/v3/domains/default` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:11.051951 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef242fa-c40e-4c51-ab1d-52f1cddd668d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:11.053527 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef242fa-c40e-4c51-ab1d-52f1cddd668d None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:11.060485 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 21/42] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:38:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:11.062191 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef242fa-c40e-4c51-ab1d-52f1cddd668d None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:11.093776 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:11.097906 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e4fdc-7b2e-4610-b6d4-0ae5e92c8749 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:11.134046 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2059e18-f1f5-40c5-9c9d-3ae1e90f257b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:11.134591 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2059e18-f1f5-40c5-9c9d-3ae1e90f257b None admin] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:11.134873 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2059e18-f1f5-40c5-9c9d-3ae1e90f257b None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:11.135150 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2059e18-f1f5-40c5-9c9d-3ae1e90f257b None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:11.135832 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2059e18-f1f5-40c5-9c9d-3ae1e90f257b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:11.137721 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2059e18-f1f5-40c5-9c9d-3ae1e90f257b None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:11.150186 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:11.166012 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef242fa-c40e-4c51-ab1d-52f1cddd668d None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:11.200827 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab987e6-9cad-43d5-b6c6-9bb9590d3452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:11.201518 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab987e6-9cad-43d5-b6c6-9bb9590d3452 None admin] REQUEST_METHOD: `PUT` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:11.201801 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab987e6-9cad-43d5-b6c6-9bb9590d3452 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:11.202085 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab987e6-9cad-43d5-b6c6-9bb9590d3452 None admin] PATH_INFO: `/v3/domains/default/users/a681f7ed1c9344b28a9297878afcbf46/roles/f13055bcebf847bf8b46160ded13810b` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:11.204242 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab987e6-9cad-43d5-b6c6-9bb9590d3452 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a681f7ed1c9344b28a9297878afcbf46, role_id=f13055bcebf847bf8b46160ded13810b)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:11.205919 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab987e6-9cad-43d5-b6c6-9bb9590d3452 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:11.224089 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 22/43] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Aug 26 00:38:10 2022] POST /identity/v3/roles => generated 223 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:11.224937 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2059e18-f1f5-40c5-9c9d-3ae1e90f257b None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:11.299017 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 22/44] 10.222.0.20 () {58 vars in 1361 bytes} [Fri Aug 26 00:38:11 2022] PUT /identity/v3/domains/default/users/a681f7ed1c9344b28a9297878afcbf46/roles/f13055bcebf847bf8b46160ded13810b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:38:11.348593 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2059e18-f1f5-40c5-9c9d-3ae1e90f257b None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:11.394856 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d598c-5e39-40cc-8088-4f9a5549edcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:11.395772 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d598c-5e39-40cc-8088-4f9a5549edcf None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:11.396169 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d598c-5e39-40cc-8088-4f9a5549edcf None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:11.396617 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d598c-5e39-40cc-8088-4f9a5549edcf None admin] PATH_INFO: `/v3/domains/default` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:11.398291 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d598c-5e39-40cc-8088-4f9a5549edcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:11.400076 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d598c-5e39-40cc-8088-4f9a5549edcf None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:11.402891 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 23/45] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:38:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:11.409059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab987e6-9cad-43d5-b6c6-9bb9590d3452 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:11.532694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab987e6-9cad-43d5-b6c6-9bb9590d3452 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:11.568726 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f2f0b-df73-40a3-a2cf-b9919b1f0bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:11.569420 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f2f0b-df73-40a3-a2cf-b9919b1f0bce None admin] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:11.569784 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f2f0b-df73-40a3-a2cf-b9919b1f0bce None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:11.570060 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f2f0b-df73-40a3-a2cf-b9919b1f0bce None admin] PATH_INFO: `/v3/projects` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:11.570712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f2f0b-df73-40a3-a2cf-b9919b1f0bce None admin] RBAC: Authorizing `identity:create_project()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:11.572255 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f2f0b-df73-40a3-a2cf-b9919b1f0bce None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:11.589617 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:11.672179 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 23/46] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 26 00:38:11 2022] POST /identity/v3/projects => generated 312 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:13.521279 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c1e4f-43a5-41a6-86a4-870b18ebdf53 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:13.521826 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c1e4f-43a5-41a6-86a4-870b18ebdf53 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:13.521908 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c1e4f-43a5-41a6-86a4-870b18ebdf53 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:13.523253 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 24/47] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:13.529206 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763af242-7eb7-4020-a85b-e56321666314 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:13.530046 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763af242-7eb7-4020-a85b-e56321666314 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:13.530325 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763af242-7eb7-4020-a85b-e56321666314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:13.548973 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-763af242-7eb7-4020-a85b-e56321666314 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:13.550213 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-763af242-7eb7-4020-a85b-e56321666314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:13.618307 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 24/48] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:13.884036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3b53d-a226-4ed9-968b-aa5f397faa7b None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:13.884300 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3b53d-a226-4ed9-968b-aa5f397faa7b None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:13.884547 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3b53d-a226-4ed9-968b-aa5f397faa7b None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:13.886065 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 25/49] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:13.891750 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65f90a-489b-49e0-9dd8-15152d5dd5a9 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:13.892118 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65f90a-489b-49e0-9dd8-15152d5dd5a9 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:13.892483 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65f90a-489b-49e0-9dd8-15152d5dd5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:13.911760 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-1b65f90a-489b-49e0-9dd8-15152d5dd5a9 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:13.912995 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-1b65f90a-489b-49e0-9dd8-15152d5dd5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:13.942622 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3b53d-a226-4ed9-968b-aa5f397faa7b None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:13.972477 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:13.983634 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 25/50] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:14.049694 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3b53d-a226-4ed9-968b-aa5f397faa7b None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:14.083511 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c548e5a-1d58-4bc6-bff6-43d54cb25b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:14.084143 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c548e5a-1d58-4bc6-bff6-43d54cb25b7e None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:14.084430 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c548e5a-1d58-4bc6-bff6-43d54cb25b7e None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:14.084711 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c548e5a-1d58-4bc6-bff6-43d54cb25b7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:14.095427 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c548e5a-1d58-4bc6-bff6-43d54cb25b7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:38:14.100242 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-7c548e5a-1d58-4bc6-bff6-43d54cb25b7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:38:14.100242 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:14.100242 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:14.100242 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:14.100242 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:14.100242 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:14.100242 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:14.100242 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:14.100242 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:14.100242 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:14.100242 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:14.100242 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:14.100242 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:38:14.100242 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:38:14.100242 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:38:14.100242 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:38:14.101078 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:38:14.101078 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:38:14.101078 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:38:14.101078 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:38:14.101078 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:14.101078 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:14.101078 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:14.101078 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:14.101078 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:14.101078 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:14.101078 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:14.101078 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:14.101078 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:14.101078 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:14.101078 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:14.101078 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:14.101868 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:14.101868 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:14.101868 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:14.101868 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:14.101868 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:38:14.101868 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:38:14.101868 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:38:14.101868 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:38:14.101868 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:38:14.101868 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:38:14.101868 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:38:14.101868 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:38:14.101868 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 26/51] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 00:38:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:38:14.107389 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65f90a-489b-49e0-9dd8-15152d5dd5a9 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:14.165136 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:14.211166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65f90a-489b-49e0-9dd8-15152d5dd5a9 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:14.246434 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545b2d3-756b-4b89-be79-e4424792a13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:14.247054 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545b2d3-756b-4b89-be79-e4424792a13d None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:14.247341 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545b2d3-756b-4b89-be79-e4424792a13d None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:14.247615 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545b2d3-756b-4b89-be79-e4424792a13d None admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:14.248349 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545b2d3-756b-4b89-be79-e4424792a13d None admin] RBAC: Adding query filter params (name=admin) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:14.248724 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545b2d3-756b-4b89-be79-e4424792a13d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:14.250082 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545b2d3-756b-4b89-be79-e4424792a13d None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:14.262866 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 26/52] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:38:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:14.268701 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c548e5a-1d58-4bc6-bff6-43d54cb25b7e None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:14.311205 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545b2d3-756b-4b89-be79-e4424792a13d None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:14.359910 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:14.375656 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c548e5a-1d58-4bc6-bff6-43d54cb25b7e None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:14.412033 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503b675-7ac4-4fda-96eb-59b14b9dbd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:14.412664 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503b675-7ac4-4fda-96eb-59b14b9dbd3d None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:14.413063 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503b675-7ac4-4fda-96eb-59b14b9dbd3d None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:14.413340 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503b675-7ac4-4fda-96eb-59b14b9dbd3d None admin] PATH_INFO: `/v3/users/a681f7ed1c9344b28a9297878afcbf46` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:14.414503 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d503b675-7ac4-4fda-96eb-59b14b9dbd3d None admin] RBAC: Authorizing `identity:get_user(user_id=a681f7ed1c9344b28a9297878afcbf46)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:14.430717 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d503b675-7ac4-4fda-96eb-59b14b9dbd3d None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:14.430717 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 27/53] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:38:14 2022] GET /identity/v3/users/a681f7ed1c9344b28a9297878afcbf46 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:14.430941 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545b2d3-756b-4b89-be79-e4424792a13d None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:14.431014 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503b675-7ac4-4fda-96eb-59b14b9dbd3d None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:14.439250 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:14.458691 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86447a6d-d4e4-4761-9923-eff04c155fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:14.459335 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86447a6d-d4e4-4761-9923-eff04c155fa9 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:14.459620 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86447a6d-d4e4-4761-9923-eff04c155fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:14.459893 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86447a6d-d4e4-4761-9923-eff04c155fa9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:14.461043 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86447a6d-d4e4-4761-9923-eff04c155fa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:14.462554 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86447a6d-d4e4-4761-9923-eff04c155fa9 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:14.464252 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 27/54] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:38:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:38:14.471052 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86447a6d-d4e4-4761-9923-eff04c155fa9 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:14.539412 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503b675-7ac4-4fda-96eb-59b14b9dbd3d None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:14.577132 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6920fe-c920-4c24-8ce1-215b8286b164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:14.577857 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6920fe-c920-4c24-8ce1-215b8286b164 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:14.578139 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6920fe-c920-4c24-8ce1-215b8286b164 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:14.578426 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6920fe-c920-4c24-8ce1-215b8286b164 None admin] PATH_INFO: `/v3/domains/default` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:14.579584 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6920fe-c920-4c24-8ce1-215b8286b164 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:14.581058 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6920fe-c920-4c24-8ce1-215b8286b164 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:14.581204 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86447a6d-d4e4-4761-9923-eff04c155fa9 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:14.582864 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 28/55] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:38:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:38:14.588577 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6920fe-c920-4c24-8ce1-215b8286b164 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:14.614420 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:14.619964 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c270445-23ea-4fca-a145-bead08b2eaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:14.620581 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c270445-23ea-4fca-a145-bead08b2eaa3 None admin] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:14.620893 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c270445-23ea-4fca-a145-bead08b2eaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:14.621733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c270445-23ea-4fca-a145-bead08b2eaa3 None admin] PATH_INFO: `/v3/projects` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:14.622381 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c270445-23ea-4fca-a145-bead08b2eaa3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:14.623832 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c270445-23ea-4fca-a145-bead08b2eaa3 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:14.699622 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6920fe-c920-4c24-8ce1-215b8286b164 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:14.733414 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66fe98-f4b0-4d9e-9c10-978a6e6ec577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:14.734042 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66fe98-f4b0-4d9e-9c10-978a6e6ec577 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:14.734331 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66fe98-f4b0-4d9e-9c10-978a6e6ec577 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:14.734610 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66fe98-f4b0-4d9e-9c10-978a6e6ec577 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:14.740252 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc66fe98-f4b0-4d9e-9c10-978a6e6ec577 None admin] RBAC: Adding query filter params (role.id=f13055bcebf847bf8b46160ded13810b, scope.domain.id=default, user.id=a681f7ed1c9344b28a9297878afcbf46) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:14.740252 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc66fe98-f4b0-4d9e-9c10-978a6e6ec577 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:14.740252 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc66fe98-f4b0-4d9e-9c10-978a6e6ec577 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:14.743007 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 29/56] 10.222.0.20 () {56 vars in 1322 bytes} [Fri Aug 26 00:38:14 2022] GET /identity/v3/role_assignments?user.id=a681f7ed1c9344b28a9297878afcbf46&scope.domain.id=default&role.id=f13055bcebf847bf8b46160ded13810b => generated 530 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:38:14.820411 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 28/57] 10.222.0.20 () {60 vars in 1140 bytes} [Fri Aug 26 00:38:14 2022] POST /identity/v3/projects => generated 298 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:38:17.035877 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bb8c6-6334-48d2-9e6c-5b0d5b2b0f40 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:17.036440 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bb8c6-6334-48d2-9e6c-5b0d5b2b0f40 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:17.036440 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bb8c6-6334-48d2-9e6c-5b0d5b2b0f40 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:17.037831 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 30/58] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:17.043148 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1600b4-054e-441e-84a3-485a45a2d4a1 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:17.043737 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1600b4-054e-441e-84a3-485a45a2d4a1 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:17.043906 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1600b4-054e-441e-84a3-485a45a2d4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:17.062352 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-cb1600b4-054e-441e-84a3-485a45a2d4a1 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:17.063573 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-cb1600b4-054e-441e-84a3-485a45a2d4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:17.093944 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:17.130840 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 29/59] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:17.463019 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9bb8c6-6334-48d2-9e6c-5b0d5b2b0f40 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:17.551573 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:17.568635 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9bb8c6-6334-48d2-9e6c-5b0d5b2b0f40 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:17.603807 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba15cc-56dd-4211-bc59-4dcdceb75f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:17.604447 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba15cc-56dd-4211-bc59-4dcdceb75f7a None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:17.604736 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba15cc-56dd-4211-bc59-4dcdceb75f7a None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:17.605014 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba15cc-56dd-4211-bc59-4dcdceb75f7a None admin] PATH_INFO: `/v3/domains/default` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:17.606718 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba15cc-56dd-4211-bc59-4dcdceb75f7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:17.608171 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba15cc-56dd-4211-bc59-4dcdceb75f7a None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:17.609823 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 31/60] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:38:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:17.616173 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1600b4-054e-441e-84a3-485a45a2d4a1 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:17.717219 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1600b4-054e-441e-84a3-485a45a2d4a1 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:17.752969 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a3128-5497-4813-942f-af99dac1ac29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:17.753607 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a3128-5497-4813-942f-af99dac1ac29 None admin] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:17.753896 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a3128-5497-4813-942f-af99dac1ac29 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:17.754178 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a3128-5497-4813-942f-af99dac1ac29 None admin] PATH_INFO: `/v3/users` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:17.754841 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a3128-5497-4813-942f-af99dac1ac29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:17.756310 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a3128-5497-4813-942f-af99dac1ac29 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:17.864000 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 30/61] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 26 00:38:17 2022] POST /identity/v3/users => generated 275 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:21.460898 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fb1f3-18b1-432e-bcca-3816c911426c None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:21.461482 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fb1f3-18b1-432e-bcca-3816c911426c None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:21.461710 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fb1f3-18b1-432e-bcca-3816c911426c None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:21.478236 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 32/62] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:21 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:21.495477 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf96d4-055b-4040-8a0d-c96da3994c12 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:21.496846 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf96d4-055b-4040-8a0d-c96da3994c12 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:21.497414 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf96d4-055b-4040-8a0d-c96da3994c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:21.502763 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371cc93-a6eb-4f40-a988-db6ad836d287 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:21.503055 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371cc93-a6eb-4f40-a988-db6ad836d287 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:21.503346 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371cc93-a6eb-4f40-a988-db6ad836d287 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:21.504960 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 33/63] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:21.512186 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb22ddd-e18a-453e-ac13-ab0e1217bc2a None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:21.512496 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb22ddd-e18a-453e-ac13-ab0e1217bc2a None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:21.513024 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb22ddd-e18a-453e-ac13-ab0e1217bc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:21.536965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-0baf96d4-055b-4040-8a0d-c96da3994c12 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:21.538304 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-0baf96d4-055b-4040-8a0d-c96da3994c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:21.554616 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-2bb22ddd-e18a-453e-ac13-ab0e1217bc2a None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:21.556222 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-2bb22ddd-e18a-453e-ac13-ab0e1217bc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:21.585800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:21.674572 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 34/64] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:21.674766 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 31/65] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:21.682266 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b2ad4-14c1-4641-832a-90e6b87281e1 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:21.682816 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b2ad4-14c1-4641-832a-90e6b87281e1 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:21.683800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b2ad4-14c1-4641-832a-90e6b87281e1 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:21.690946 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 32/66] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:21 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:21.696895 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a50e7-f027-4a1c-ade8-995511f63d44 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:21.697193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a50e7-f027-4a1c-ade8-995511f63d44 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:21.697516 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a50e7-f027-4a1c-ade8-995511f63d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:21.731282 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-ba9a50e7-f027-4a1c-ade8-995511f63d44 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:21.732533 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-ba9a50e7-f027-4a1c-ade8-995511f63d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:21.810615 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735a5d2-ee5e-4494-8882-45e23d5026ca None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:21.811271 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735a5d2-ee5e-4494-8882-45e23d5026ca None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:21.811779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735a5d2-ee5e-4494-8882-45e23d5026ca None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:21.816668 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 33/67] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:21.818356 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ddada-fe3d-4e23-a1ee-ec0628ee90e4 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:21.818869 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ddada-fe3d-4e23-a1ee-ec0628ee90e4 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:21.819368 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ddada-fe3d-4e23-a1ee-ec0628ee90e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:21.832405 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 35/68] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:21.854408 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-d30ddada-fe3d-4e23-a1ee-ec0628ee90e4 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:21.855672 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-d30ddada-fe3d-4e23-a1ee-ec0628ee90e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:21.955743 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 34/69] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:22.049086 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a50e7-f027-4a1c-ade8-995511f63d44 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:22.069903 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:22.092941 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a778a4-c671-4d13-93c8-b5ada0405618 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:22.093615 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a778a4-c671-4d13-93c8-b5ada0405618 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:22.094123 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a778a4-c671-4d13-93c8-b5ada0405618 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:22.095730 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 35/70] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:38:22.101033 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b73d5-3fe3-4e49-ba0c-049ba7eda657 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:22.101602 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b73d5-3fe3-4e49-ba0c-049ba7eda657 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:22.102113 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b73d5-3fe3-4e49-ba0c-049ba7eda657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:22.136014 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-fe0b73d5-3fe3-4e49-ba0c-049ba7eda657 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:22.137909 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-fe0b73d5-3fe3-4e49-ba0c-049ba7eda657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:22.172129 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a50e7-f027-4a1c-ade8-995511f63d44 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:22.211605 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2209e3d-1fe3-4242-b5ea-9b863f34a57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:22.212290 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2209e3d-1fe3-4242-b5ea-9b863f34a57d None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:22.212655 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2209e3d-1fe3-4242-b5ea-9b863f34a57d None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:22.213008 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2209e3d-1fe3-4242-b5ea-9b863f34a57d None admin] PATH_INFO: `/v3/roles/member` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:22.224699 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2209e3d-1fe3-4242-b5ea-9b863f34a57d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:38:22.229870 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-a2209e3d-1fe3-4242-b5ea-9b863f34a57d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:38:22.229870 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:22.229870 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:22.229870 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:22.229870 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:22.229870 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:22.229870 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:22.229870 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:22.229870 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:22.229870 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:22.229870 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:22.229870 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:22.229870 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:38:22.229870 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:38:22.229870 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:38:22.229870 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:38:22.231798 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:38:22.231798 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:38:22.231798 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:38:22.231798 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:38:22.231798 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:22.231798 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:22.231798 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:22.231798 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:22.231798 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:22.231798 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:22.231798 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:22.231798 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:22.231798 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:22.231798 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:22.231798 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:22.231798 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:22.232557 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:22.232557 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:22.232557 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:22.232557 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:22.232557 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:38:22.232557 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:38:22.232557 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:38:22.232557 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:38:22.232557 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:38:22.232557 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:38:22.232557 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:38:22.232557 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:38:22.232557 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 36/71] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:38:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:38:22.237972 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2209e3d-1fe3-4242-b5ea-9b863f34a57d None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:22.239461 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 36/72] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:22.245416 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b73d5-3fe3-4e49-ba0c-049ba7eda657 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:22.264078 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:22.341651 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:22.372578 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2209e3d-1fe3-4242-b5ea-9b863f34a57d None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:22.376032 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b73d5-3fe3-4e49-ba0c-049ba7eda657 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:22.412980 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9236c-ddd4-47b6-bdbf-b88f8e106769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:22.413646 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67335046-5ff5-42c8-b975-cc1fa2cbd34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:22.414270 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67335046-5ff5-42c8-b975-cc1fa2cbd34f None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:22.414471 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9236c-ddd4-47b6-bdbf-b88f8e106769 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:22.414565 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67335046-5ff5-42c8-b975-cc1fa2cbd34f None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:22.414833 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67335046-5ff5-42c8-b975-cc1fa2cbd34f None admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:22.415240 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9236c-ddd4-47b6-bdbf-b88f8e106769 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:22.415513 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67335046-5ff5-42c8-b975-cc1fa2cbd34f None admin] RBAC: Adding query filter params (name=member) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:22.415829 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67335046-5ff5-42c8-b975-cc1fa2cbd34f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:22.416156 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9236c-ddd4-47b6-bdbf-b88f8e106769 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:22.417268 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67335046-5ff5-42c8-b975-cc1fa2cbd34f None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:22.429426 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 37/73] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 00:38:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:22.429426 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67335046-5ff5-42c8-b975-cc1fa2cbd34f None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:22.434875 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9236c-ddd4-47b6-bdbf-b88f8e106769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:38:22.439785 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-15e9236c-ddd4-47b6-bdbf-b88f8e106769 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:38:22.439785 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:22.439785 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:22.439785 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:22.439785 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:22.439785 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:22.439785 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:22.439785 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:22.439785 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:22.439785 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:22.439785 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:22.439785 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:22.439785 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:38:22.439785 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:38:22.439785 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:38:22.439785 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:38:22.440633 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:38:22.440633 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:38:22.440633 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:38:22.440633 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:38:22.440633 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:22.440633 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:22.440633 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:22.440633 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:22.440633 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:22.440633 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:22.440633 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:22.440633 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:22.440633 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:22.440633 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:22.440633 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:22.440633 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:22.441561 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:22.441561 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:22.441561 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:22.441561 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:22.441561 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:38:22.441561 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:38:22.441561 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:38:22.441561 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:38:22.441561 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:38:22.441561 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:38:22.441561 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:38:22.441561 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:38:22.441561 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 37/74] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 00:38:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:38:22.443065 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9236c-ddd4-47b6-bdbf-b88f8e106769 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:22.515779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:22.540454 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67335046-5ff5-42c8-b975-cc1fa2cbd34f None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:22.560588 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9236c-ddd4-47b6-bdbf-b88f8e106769 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:22.580127 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b2cda-cb24-484c-9adf-529b258ce60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:22.580773 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b2cda-cb24-484c-9adf-529b258ce60b None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:22.581060 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b2cda-cb24-484c-9adf-529b258ce60b None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:22.581335 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b2cda-cb24-484c-9adf-529b258ce60b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:22.596688 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b2cda-cb24-484c-9adf-529b258ce60b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:38:22.598266 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3115da-9cf4-454e-b3a3-53d744aa6c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:22.598912 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3115da-9cf4-454e-b3a3-53d744aa6c79 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:22.599196 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3115da-9cf4-454e-b3a3-53d744aa6c79 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:22.599474 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3115da-9cf4-454e-b3a3-53d744aa6c79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:22.600609 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3115da-9cf4-454e-b3a3-53d744aa6c79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:22.602100 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3115da-9cf4-454e-b3a3-53d744aa6c79 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:22.602672 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-bb9b2cda-cb24-484c-9adf-529b258ce60b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:38:22.602672 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:22.602672 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:22.602672 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:22.602672 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:22.602672 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:22.602672 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:22.602672 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:22.602672 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:22.602672 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:22.602672 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:22.602672 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:22.602672 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:38:22.602672 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:38:22.602672 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:38:22.602672 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:38:22.603594 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:38:22.603594 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:38:22.603594 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:38:22.603594 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:38:22.603594 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:22.603594 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:22.603594 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:22.603594 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:22.603594 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:22.603594 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:22.603594 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:22.603594 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:22.603594 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:22.603594 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:22.603594 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:22.603594 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:22.604329 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:22.604329 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:22.604329 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:22.604329 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:22.604329 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:38:22.604329 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:38:22.604329 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:38:22.604329 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:38:22.604329 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:38:22.604329 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:38:22.604329 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:38:22.604329 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:38:22.604934 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 38/75] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:38:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:22.605005 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 38/76] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 00:38:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:38:22.605753 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3115da-9cf4-454e-b3a3-53d744aa6c79 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:22.605883 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b2cda-cb24-484c-9adf-529b258ce60b None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:22.611234 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:22.709736 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b2cda-cb24-484c-9adf-529b258ce60b None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:22.710412 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3115da-9cf4-454e-b3a3-53d744aa6c79 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:22.746186 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf890bc-e759-45fb-b8d6-6c1282f94356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:22.747275 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf890bc-e759-45fb-b8d6-6c1282f94356 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:22.747549 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b6b28-1311-4f0e-9eb8-c0d66e68457f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:22.747683 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf890bc-e759-45fb-b8d6-6c1282f94356 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:22.747920 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf890bc-e759-45fb-b8d6-6c1282f94356 None admin] PATH_INFO: `/v3/users/18e223919a594043ac62adff17d731d8` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:22.748172 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b6b28-1311-4f0e-9eb8-c0d66e68457f None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:22.748460 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b6b28-1311-4f0e-9eb8-c0d66e68457f None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:22.748741 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b6b28-1311-4f0e-9eb8-c0d66e68457f None admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:22.749448 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b6b28-1311-4f0e-9eb8-c0d66e68457f None admin] RBAC: Adding query filter params (name=admin) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:22.749779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b6b28-1311-4f0e-9eb8-c0d66e68457f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:22.751181 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b6b28-1311-4f0e-9eb8-c0d66e68457f None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:22.753524 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:22.760290 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 39/77] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:38:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:22.761124 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b6b28-1311-4f0e-9eb8-c0d66e68457f None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:22.762655 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf890bc-e759-45fb-b8d6-6c1282f94356 None admin] RBAC: Authorizing `identity:get_user(user_id=18e223919a594043ac62adff17d731d8)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:22.764141 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf890bc-e759-45fb-b8d6-6c1282f94356 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:22.776164 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 39/78] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:38:22 2022] GET /identity/v3/users/18e223919a594043ac62adff17d731d8 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:22.776164 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf890bc-e759-45fb-b8d6-6c1282f94356 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:22.838371 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:22.882178 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b6b28-1311-4f0e-9eb8-c0d66e68457f None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:22.891078 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf890bc-e759-45fb-b8d6-6c1282f94356 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:22.923850 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be352a-0a93-4c6a-8479-7a54fbf72aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:22.924502 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be352a-0a93-4c6a-8479-7a54fbf72aa7 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:22.924791 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be352a-0a93-4c6a-8479-7a54fbf72aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:22.925075 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be352a-0a93-4c6a-8479-7a54fbf72aa7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:22.930086 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d940e-a991-4203-afad-b9216ec9b816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:22.930709 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d940e-a991-4203-afad-b9216ec9b816 None admin] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:22.931002 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d940e-a991-4203-afad-b9216ec9b816 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:22.931281 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d940e-a991-4203-afad-b9216ec9b816 None admin] PATH_INFO: `/v3/users` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:22.931946 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d940e-a991-4203-afad-b9216ec9b816 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:22.934015 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d940e-a991-4203-afad-b9216ec9b816 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:22.939341 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be352a-0a93-4c6a-8479-7a54fbf72aa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:38:22.944616 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-e1be352a-0a93-4c6a-8479-7a54fbf72aa7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:38:22.944616 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:22.944616 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:22.944616 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:22.944616 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:22.944616 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:22.944616 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:22.944616 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:22.944616 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:22.944616 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:22.944616 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:22.944616 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:22.944616 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:38:22.944616 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:38:22.944616 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:38:22.944616 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:38:22.945641 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:38:22.945641 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:38:22.945641 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:38:22.945641 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:38:22.945641 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:22.945641 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:22.945641 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:22.945641 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:22.945641 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:22.945641 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:22.945641 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:22.945641 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:22.945641 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:22.945641 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:22.945641 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:22.945641 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:22.946445 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:22.946445 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:22.946445 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:22.946445 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:22.946445 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:38:22.946445 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:38:22.946445 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:38:22.946445 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:38:22.946445 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:38:22.946445 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:38:22.946445 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:38:22.946445 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:38:22.946445 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 40/79] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:38:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:38:22.947185 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be352a-0a93-4c6a-8479-7a54fbf72aa7 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:23.025045 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:23.052321 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 40/80] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 26 00:38:22 2022] POST /identity/v3/users => generated 289 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:23.053392 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d940e-a991-4203-afad-b9216ec9b816 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:23.070100 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be352a-0a93-4c6a-8479-7a54fbf72aa7 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:23.113090 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83142f1-aedd-4c07-a8f7-0d1dc46fd6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:23.113801 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83142f1-aedd-4c07-a8f7-0d1dc46fd6cc None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:23.114081 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83142f1-aedd-4c07-a8f7-0d1dc46fd6cc None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:23.114361 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83142f1-aedd-4c07-a8f7-0d1dc46fd6cc None admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:23.115059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83142f1-aedd-4c07-a8f7-0d1dc46fd6cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:23.115401 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83142f1-aedd-4c07-a8f7-0d1dc46fd6cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:23.116877 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83142f1-aedd-4c07-a8f7-0d1dc46fd6cc None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:23.132298 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 41/81] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:38:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:23.132298 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83142f1-aedd-4c07-a8f7-0d1dc46fd6cc None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:23.186031 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d940e-a991-4203-afad-b9216ec9b816 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:23.204454 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:23.223848 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f3795-2417-4860-8d64-046ff0df0005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:23.224513 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f3795-2417-4860-8d64-046ff0df0005 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:23.224799 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f3795-2417-4860-8d64-046ff0df0005 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:23.225078 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f3795-2417-4860-8d64-046ff0df0005 None admin] PATH_INFO: `/v3/users/a681f7ed1c9344b28a9297878afcbf46` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:23.226305 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f3795-2417-4860-8d64-046ff0df0005 None admin] RBAC: Authorizing `identity:get_user(user_id=a681f7ed1c9344b28a9297878afcbf46)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:23.227788 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f3795-2417-4860-8d64-046ff0df0005 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:23.229424 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 41/82] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:38:23 2022] GET /identity/v3/users/a681f7ed1c9344b28a9297878afcbf46 => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:23.230763 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f3795-2417-4860-8d64-046ff0df0005 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:23.272830 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83142f1-aedd-4c07-a8f7-0d1dc46fd6cc None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:23.301245 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:23.315781 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69043e44-c2df-4706-ab40-b7d7cadeb35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:23.316407 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69043e44-c2df-4706-ab40-b7d7cadeb35f None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:23.316690 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69043e44-c2df-4706-ab40-b7d7cadeb35f None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:23.316977 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69043e44-c2df-4706-ab40-b7d7cadeb35f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:23.367642 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f3795-2417-4860-8d64-046ff0df0005 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:23.413852 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69043e44-c2df-4706-ab40-b7d7cadeb35f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:23.415432 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69043e44-c2df-4706-ab40-b7d7cadeb35f None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:23.419582 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78cd55e-c320-46db-8e34-36d3b09542d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:23.420882 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78cd55e-c320-46db-8e34-36d3b09542d8 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:23.420882 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78cd55e-c320-46db-8e34-36d3b09542d8 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:23.420882 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78cd55e-c320-46db-8e34-36d3b09542d8 None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:23.421346 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78cd55e-c320-46db-8e34-36d3b09542d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:23.421690 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78cd55e-c320-46db-8e34-36d3b09542d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:23.423076 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78cd55e-c320-46db-8e34-36d3b09542d8 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:23.435399 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 42/83] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 00:38:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:23.438623 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78cd55e-c320-46db-8e34-36d3b09542d8 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:23.513152 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:23.546420 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 42/84] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:38:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:38:23.547842 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69043e44-c2df-4706-ab40-b7d7cadeb35f None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:23.582644 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:23.586093 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78cd55e-c320-46db-8e34-36d3b09542d8 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:23.624418 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017fea7-2626-4f81-9e27-26b4f49ae128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:23.625351 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017fea7-2626-4f81-9e27-26b4f49ae128 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:23.625796 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017fea7-2626-4f81-9e27-26b4f49ae128 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:23.626246 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017fea7-2626-4f81-9e27-26b4f49ae128 None admin] PATH_INFO: `/v3/users/18e223919a594043ac62adff17d731d8` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:23.627695 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017fea7-2626-4f81-9e27-26b4f49ae128 None admin] RBAC: Authorizing `identity:get_user(user_id=18e223919a594043ac62adff17d731d8)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:23.629329 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017fea7-2626-4f81-9e27-26b4f49ae128 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:23.631585 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 43/85] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:38:23 2022] GET /identity/v3/users/18e223919a594043ac62adff17d731d8 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:23.632531 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017fea7-2626-4f81-9e27-26b4f49ae128 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:23.695425 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69043e44-c2df-4706-ab40-b7d7cadeb35f None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:23.734420 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf109dd-82d5-4713-ab74-ecec7d668191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:23.735085 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf109dd-82d5-4713-ab74-ecec7d668191 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:23.735374 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf109dd-82d5-4713-ab74-ecec7d668191 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:23.735671 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf109dd-82d5-4713-ab74-ecec7d668191 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:23.768334 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017fea7-2626-4f81-9e27-26b4f49ae128 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:23.790820 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:23.818313 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556cd8b-1d55-47c4-8de1-955a3b79a5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:23.818958 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556cd8b-1d55-47c4-8de1-955a3b79a5a4 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:23.819251 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556cd8b-1d55-47c4-8de1-955a3b79a5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:23.819537 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556cd8b-1d55-47c4-8de1-955a3b79a5a4 None admin] PATH_INFO: `/v3/users/18e223919a594043ac62adff17d731d8` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:23.820992 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556cd8b-1d55-47c4-8de1-955a3b79a5a4 None admin] RBAC: Authorizing `identity:get_user(user_id=18e223919a594043ac62adff17d731d8)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:23.822258 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556cd8b-1d55-47c4-8de1-955a3b79a5a4 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:23.823546 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf109dd-82d5-4713-ab74-ecec7d668191 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:23.826686 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf109dd-82d5-4713-ab74-ecec7d668191 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:23.829147 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 44/86] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:38:23 2022] GET /identity/v3/users/18e223919a594043ac62adff17d731d8 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:23.830912 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556cd8b-1d55-47c4-8de1-955a3b79a5a4 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:23.856715 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:23.956536 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 43/87] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:38:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:38:23.957847 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf109dd-82d5-4713-ab74-ecec7d668191 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:23.961462 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556cd8b-1d55-47c4-8de1-955a3b79a5a4 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:24.005543 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d923021-20d6-409c-b9d9-d949d01bbd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:24.006555 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d923021-20d6-409c-b9d9-d949d01bbd0e None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:24.007386 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d923021-20d6-409c-b9d9-d949d01bbd0e None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:24.008077 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d923021-20d6-409c-b9d9-d949d01bbd0e None admin] PATH_INFO: `/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:24.010108 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d923021-20d6-409c-b9d9-d949d01bbd0e None admin] RBAC: Authorizing `identity:get_project(project_id=dd1ea6c1f8214651a9e7c21e90adac21)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:24.012337 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d923021-20d6-409c-b9d9-d949d01bbd0e None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:24.014964 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 45/88] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:38:23 2022] GET /identity/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:24.016233 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d923021-20d6-409c-b9d9-d949d01bbd0e None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:24.080096 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf109dd-82d5-4713-ab74-ecec7d668191 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:24.089259 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:24.106588 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:24.129187 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea698f2b-551a-4aa6-9a7d-207bb917ecbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:24.130609 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea698f2b-551a-4aa6-9a7d-207bb917ecbc None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:24.131364 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea698f2b-551a-4aa6-9a7d-207bb917ecbc None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:24.131841 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea698f2b-551a-4aa6-9a7d-207bb917ecbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:24.155293 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d923021-20d6-409c-b9d9-d949d01bbd0e None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:24.194482 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d90aa7-d186-4a50-9d65-4d4bacf65676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:24.195181 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d90aa7-d186-4a50-9d65-4d4bacf65676 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:24.195661 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d90aa7-d186-4a50-9d65-4d4bacf65676 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:24.195949 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d90aa7-d186-4a50-9d65-4d4bacf65676 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:24.234724 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea698f2b-551a-4aa6-9a7d-207bb917ecbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:24.237410 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea698f2b-551a-4aa6-9a7d-207bb917ecbc None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:24.278814 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d90aa7-d186-4a50-9d65-4d4bacf65676 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:24.280859 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d90aa7-d186-4a50-9d65-4d4bacf65676 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:24.336752 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:24.367135 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 44/89] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:38:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:38:24.368074 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea698f2b-551a-4aa6-9a7d-207bb917ecbc None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:24.405827 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 46/90] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:38:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:38:24.406691 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d90aa7-d186-4a50-9d65-4d4bacf65676 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:24.408520 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:24.513253 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea698f2b-551a-4aa6-9a7d-207bb917ecbc None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:24.533174 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d90aa7-d186-4a50-9d65-4d4bacf65676 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:24.562379 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784d1c5-c7bb-480b-b4f8-26b82850d52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:24.564224 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784d1c5-c7bb-480b-b4f8-26b82850d52d None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:24.564702 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784d1c5-c7bb-480b-b4f8-26b82850d52d None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:24.565180 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784d1c5-c7bb-480b-b4f8-26b82850d52d None admin] PATH_INFO: `/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:24.567260 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784d1c5-c7bb-480b-b4f8-26b82850d52d None admin] RBAC: Authorizing `identity:get_project(project_id=dd1ea6c1f8214651a9e7c21e90adac21)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:24.568888 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784d1c5-c7bb-480b-b4f8-26b82850d52d None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:24.570741 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 45/91] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:38:24 2022] GET /identity/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:24.571495 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b135f-2a78-4050-811e-3b2166a68e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:24.571888 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784d1c5-c7bb-480b-b4f8-26b82850d52d None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:24.572347 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b135f-2a78-4050-811e-3b2166a68e8f None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:24.572784 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b135f-2a78-4050-811e-3b2166a68e8f None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:24.573270 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b135f-2a78-4050-811e-3b2166a68e8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:24.574636 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b135f-2a78-4050-811e-3b2166a68e8f None admin] RBAC: Adding query filter params (role.id=64e752fa5df040c1a0b12914b5dacd49, scope.project.id=dd1ea6c1f8214651a9e7c21e90adac21, user.id=18e223919a594043ac62adff17d731d8) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:24.575057 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b135f-2a78-4050-811e-3b2166a68e8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:24.576891 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b135f-2a78-4050-811e-3b2166a68e8f None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:24.582911 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 47/92] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 00:38:24 2022] GET /identity/v3/role_assignments?user.id=18e223919a594043ac62adff17d731d8&scope.project.id=dd1ea6c1f8214651a9e7c21e90adac21&role.id=64e752fa5df040c1a0b12914b5dacd49 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:24.584043 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b135f-2a78-4050-811e-3b2166a68e8f None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:24.622066 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:24.694675 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:24.711251 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784d1c5-c7bb-480b-b4f8-26b82850d52d None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:24.755194 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48012fa2-d51f-4c35-8140-866753635ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:24.756622 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48012fa2-d51f-4c35-8140-866753635ac6 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:24.757687 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48012fa2-d51f-4c35-8140-866753635ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:24.758164 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48012fa2-d51f-4c35-8140-866753635ac6 None admin] PATH_INFO: `/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:24.760008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48012fa2-d51f-4c35-8140-866753635ac6 None admin] RBAC: Authorizing `identity:get_project(project_id=dd1ea6c1f8214651a9e7c21e90adac21)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:24.764020 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48012fa2-d51f-4c35-8140-866753635ac6 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:24.766489 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 46/93] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:38:24 2022] GET /identity/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:24.767568 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48012fa2-d51f-4c35-8140-866753635ac6 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:24.814998 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b135f-2a78-4050-811e-3b2166a68e8f None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:24.868317 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd293456-2480-4f79-9882-5d27cba7d7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:24.869451 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd293456-2480-4f79-9882-5d27cba7d7d6 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:24.869951 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd293456-2480-4f79-9882-5d27cba7d7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:24.873302 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd293456-2480-4f79-9882-5d27cba7d7d6 None admin] PATH_INFO: `/v3/projects/a5e45241feaf4c72aea9f1e2d54098a0` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:24.875034 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd293456-2480-4f79-9882-5d27cba7d7d6 None admin] RBAC: Authorizing `identity:get_project(project_id=a5e45241feaf4c72aea9f1e2d54098a0)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:24.878125 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd293456-2480-4f79-9882-5d27cba7d7d6 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:24.887258 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 48/94] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:38:24 2022] GET /identity/v3/projects/a5e45241feaf4c72aea9f1e2d54098a0 => generated 312 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:24.888640 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd293456-2480-4f79-9882-5d27cba7d7d6 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:24.949965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48012fa2-d51f-4c35-8140-866753635ac6 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:25.000136 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6cbb7-9b0e-490c-bbee-2046921825eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:25.000769 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6cbb7-9b0e-490c-bbee-2046921825eb None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:25.001059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6cbb7-9b0e-490c-bbee-2046921825eb None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:25.001343 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6cbb7-9b0e-490c-bbee-2046921825eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:25.002124 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6cbb7-9b0e-490c-bbee-2046921825eb None admin] RBAC: Adding query filter params (role.id=f13055bcebf847bf8b46160ded13810b, scope.project.id=dd1ea6c1f8214651a9e7c21e90adac21, user.id=a681f7ed1c9344b28a9297878afcbf46) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:25.002443 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6cbb7-9b0e-490c-bbee-2046921825eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:25.003913 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6cbb7-9b0e-490c-bbee-2046921825eb None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:25.020647 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 47/95] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 00:38:24 2022] GET /identity/v3/role_assignments?user.id=a681f7ed1c9344b28a9297878afcbf46&scope.project.id=dd1ea6c1f8214651a9e7c21e90adac21&role.id=f13055bcebf847bf8b46160ded13810b => generated 259 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:25.021885 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6cbb7-9b0e-490c-bbee-2046921825eb None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:25.076287 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:25.092463 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:25.127644 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd293456-2480-4f79-9882-5d27cba7d7d6 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:25.212094 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95853237-9ccf-45d8-a1d3-ba8d799e74f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:25.212733 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95853237-9ccf-45d8-a1d3-ba8d799e74f7 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:25.213025 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95853237-9ccf-45d8-a1d3-ba8d799e74f7 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:25.213311 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95853237-9ccf-45d8-a1d3-ba8d799e74f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:25.217404 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95853237-9ccf-45d8-a1d3-ba8d799e74f7 None admin] RBAC: Adding query filter params (role.id=f0a369eda5014bb78b2d752c9abef48f, scope.project.id=dd1ea6c1f8214651a9e7c21e90adac21, user.id=18e223919a594043ac62adff17d731d8) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:25.217404 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95853237-9ccf-45d8-a1d3-ba8d799e74f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:25.217404 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95853237-9ccf-45d8-a1d3-ba8d799e74f7 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:25.224580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 49/96] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 00:38:24 2022] GET /identity/v3/role_assignments?user.id=18e223919a594043ac62adff17d731d8&scope.project.id=dd1ea6c1f8214651a9e7c21e90adac21&role.id=f0a369eda5014bb78b2d752c9abef48f => generated 259 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:25.256477 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6cbb7-9b0e-490c-bbee-2046921825eb None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:25.317160 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159df95e-46de-4501-8099-4527833b798e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:25.317749 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159df95e-46de-4501-8099-4527833b798e None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:25.318078 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159df95e-46de-4501-8099-4527833b798e None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:25.318315 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159df95e-46de-4501-8099-4527833b798e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:25.319084 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159df95e-46de-4501-8099-4527833b798e None admin] RBAC: Adding query filter params (role.id=64e752fa5df040c1a0b12914b5dacd49, scope.project.id=a5e45241feaf4c72aea9f1e2d54098a0, user.id=18e223919a594043ac62adff17d731d8) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:25.319416 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159df95e-46de-4501-8099-4527833b798e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:25.321027 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159df95e-46de-4501-8099-4527833b798e None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:25.333486 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 48/97] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 00:38:25 2022] GET /identity/v3/role_assignments?user.id=18e223919a594043ac62adff17d731d8&scope.project.id=a5e45241feaf4c72aea9f1e2d54098a0&role.id=64e752fa5df040c1a0b12914b5dacd49 => generated 259 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:25.832412 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae9f01-ff77-4d23-833d-e4bb39e2c9ea None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:25.832982 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae9f01-ff77-4d23-833d-e4bb39e2c9ea None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:25.832982 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae9f01-ff77-4d23-833d-e4bb39e2c9ea None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:25.834370 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 50/98] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:25.844447 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15915850-9d5e-422e-ad0d-0d0d3a063dfd None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:25.844955 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15915850-9d5e-422e-ad0d-0d0d3a063dfd None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:25.845190 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15915850-9d5e-422e-ad0d-0d0d3a063dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:25.871610 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-15915850-9d5e-422e-ad0d-0d0d3a063dfd None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:25.872934 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-15915850-9d5e-422e-ad0d-0d0d3a063dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:25.903991 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa1b2a-d70a-4508-9bd6-3dd25974bf50 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:25.904310 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa1b2a-d70a-4508-9bd6-3dd25974bf50 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:25.904572 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa1b2a-d70a-4508-9bd6-3dd25974bf50 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:25.905967 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 51/99] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:38:25.911411 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01190a8-a2e6-436c-9438-a867692bc8fb None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:25.911713 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01190a8-a2e6-436c-9438-a867692bc8fb None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:25.911998 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01190a8-a2e6-436c-9438-a867692bc8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:25.969506 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-a01190a8-a2e6-436c-9438-a867692bc8fb None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:25.970866 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-a01190a8-a2e6-436c-9438-a867692bc8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:25.978482 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 49/100] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:26.053800 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 52/101] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:38:26.493964 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15915850-9d5e-422e-ad0d-0d0d3a063dfd None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:26.517206 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:26.623305 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15915850-9d5e-422e-ad0d-0d0d3a063dfd None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:26.664902 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99239457-eb0b-42b9-bf40-77c01c9edbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:26.665575 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99239457-eb0b-42b9-bf40-77c01c9edbea None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:26.665861 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99239457-eb0b-42b9-bf40-77c01c9edbea None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:26.666138 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99239457-eb0b-42b9-bf40-77c01c9edbea None admin] PATH_INFO: `/v3/domains/default` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:26.667366 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99239457-eb0b-42b9-bf40-77c01c9edbea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:26.669523 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99239457-eb0b-42b9-bf40-77c01c9edbea None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:26.670529 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01190a8-a2e6-436c-9438-a867692bc8fb None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:26.671476 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 50/102] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:38:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:26.686658 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99239457-eb0b-42b9-bf40-77c01c9edbea None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:26.794034 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:26.829027 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99239457-eb0b-42b9-bf40-77c01c9edbea None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:26.839935 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:26.895614 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d3e21-0522-42ee-9a9a-07be86854cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:26.896969 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d3e21-0522-42ee-9a9a-07be86854cde None admin] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:26.902929 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d3e21-0522-42ee-9a9a-07be86854cde None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:26.903595 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d3e21-0522-42ee-9a9a-07be86854cde None admin] PATH_INFO: `/v3/projects` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:26.904507 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d3e21-0522-42ee-9a9a-07be86854cde None admin] RBAC: Authorizing `identity:create_project()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:26.906888 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d3e21-0522-42ee-9a9a-07be86854cde None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:26.923420 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01190a8-a2e6-436c-9438-a867692bc8fb None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:26.995051 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4ed56-9c2b-4725-8c37-021a4d8125e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:26.995765 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4ed56-9c2b-4725-8c37-021a4d8125e3 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:26.996556 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4ed56-9c2b-4725-8c37-021a4d8125e3 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:26.996841 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4ed56-9c2b-4725-8c37-021a4d8125e3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:27.009309 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e4ed56-9c2b-4725-8c37-021a4d8125e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:38:27.023056 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-36e4ed56-9c2b-4725-8c37-021a4d8125e3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:38:27.023056 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:27.023056 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:27.023056 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:27.023056 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:27.023056 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:27.023056 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:27.023056 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:27.023056 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:27.023056 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:27.023056 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:27.023056 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:27.023056 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:38:27.023056 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:38:27.023056 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:38:27.023056 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:38:27.023991 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:38:27.023991 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:38:27.023991 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:38:27.023991 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:38:27.023991 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:27.023991 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:27.023991 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:27.023991 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:27.023991 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:27.023991 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:27.023991 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:27.023991 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:27.023991 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:27.023991 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:27.023991 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:27.023991 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:27.024779 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:27.024779 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:27.024779 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:27.024779 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:27.024779 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:38:27.024779 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:38:27.024779 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:38:27.024779 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:38:27.024779 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:38:27.024779 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:38:27.024779 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:38:27.024779 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:38:27.024779 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 53/103] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:38:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:38:27.033161 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4ed56-9c2b-4725-8c37-021a4d8125e3 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:27.049864 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 51/104] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 26 00:38:26 2022] POST /identity/v3/projects => generated 302 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:38:27.186820 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4ed56-9c2b-4725-8c37-021a4d8125e3 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:27.236697 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bf610-a655-4dfe-b25a-24fba0bbdec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:27.237350 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bf610-a655-4dfe-b25a-24fba0bbdec9 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:27.237666 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bf610-a655-4dfe-b25a-24fba0bbdec9 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:27.237951 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bf610-a655-4dfe-b25a-24fba0bbdec9 None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:27.238648 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019bf610-a655-4dfe-b25a-24fba0bbdec9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:27.238965 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019bf610-a655-4dfe-b25a-24fba0bbdec9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:27.240431 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019bf610-a655-4dfe-b25a-24fba0bbdec9 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:27.246596 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:27.254687 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 54/105] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 00:38:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:38:27.261090 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d3e21-0522-42ee-9a9a-07be86854cde None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:27.430511 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d3e21-0522-42ee-9a9a-07be86854cde None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:27.479621 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61e950-6b89-4d7b-9d4b-b4bd4162eec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:27.480916 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61e950-6b89-4d7b-9d4b-b4bd4162eec6 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:27.481217 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61e950-6b89-4d7b-9d4b-b4bd4162eec6 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:27.481607 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61e950-6b89-4d7b-9d4b-b4bd4162eec6 None admin] PATH_INFO: `/v3/users/05cfee04eb4e4df69861caa0326b4534` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:27.487818 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:27.510044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61e950-6b89-4d7b-9d4b-b4bd4162eec6 None admin] RBAC: Authorizing `identity:get_user(user_id=05cfee04eb4e4df69861caa0326b4534)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:27.512131 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61e950-6b89-4d7b-9d4b-b4bd4162eec6 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:27.514381 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 52/106] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:38:27 2022] GET /identity/v3/users/05cfee04eb4e4df69861caa0326b4534 => generated 289 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:27.519982 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bf610-a655-4dfe-b25a-24fba0bbdec9 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:27.650401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bf610-a655-4dfe-b25a-24fba0bbdec9 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:27.693363 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7a727-640b-4e4c-b2b8-22dabf1ef32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:27.693918 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7a727-640b-4e4c-b2b8-22dabf1ef32e None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:27.694211 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7a727-640b-4e4c-b2b8-22dabf1ef32e None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:27.694496 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7a727-640b-4e4c-b2b8-22dabf1ef32e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:27.785994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:27.790722 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd7a727-640b-4e4c-b2b8-22dabf1ef32e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:27.792515 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd7a727-640b-4e4c-b2b8-22dabf1ef32e None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:27.921685 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 55/107] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:38:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:38:27.927714 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61e950-6b89-4d7b-9d4b-b4bd4162eec6 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:27.956444 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b894ed-db77-4263-949f-46614381cc90 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:27.956792 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b894ed-db77-4263-949f-46614381cc90 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:27.957007 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b894ed-db77-4263-949f-46614381cc90 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:27.958413 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 56/108] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:27.963582 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f247902-ddb5-46a5-b3f6-cd9c633c39aa None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:27.963874 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f247902-ddb5-46a5-b3f6-cd9c633c39aa None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:27.964162 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f247902-ddb5-46a5-b3f6-cd9c633c39aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:27.994517 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-4f247902-ddb5-46a5-b3f6-cd9c633c39aa None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:27.995780 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-4f247902-ddb5-46a5-b3f6-cd9c633c39aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:28.080503 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61e950-6b89-4d7b-9d4b-b4bd4162eec6 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:28.118468 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881fc39-5950-422a-bf0b-6638cb9e9a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:28.121818 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881fc39-5950-422a-bf0b-6638cb9e9a8a None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:28.121818 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881fc39-5950-422a-bf0b-6638cb9e9a8a None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:28.121818 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881fc39-5950-422a-bf0b-6638cb9e9a8a None admin] PATH_INFO: `/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:28.121818 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881fc39-5950-422a-bf0b-6638cb9e9a8a None admin] RBAC: Authorizing `identity:get_project(project_id=dd1ea6c1f8214651a9e7c21e90adac21)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:28.122792 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881fc39-5950-422a-bf0b-6638cb9e9a8a None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:28.124470 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 53/109] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:38:27 2022] GET /identity/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:28.127191 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 57/110] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:38:28.143507 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881fc39-5950-422a-bf0b-6638cb9e9a8a None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:28.230739 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:28.280247 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881fc39-5950-422a-bf0b-6638cb9e9a8a None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:28.318759 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a55205-eb84-4749-ba86-d6dbe79d9e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:28.319381 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a55205-eb84-4749-ba86-d6dbe79d9e59 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:28.319672 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a55205-eb84-4749-ba86-d6dbe79d9e59 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:28.319954 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a55205-eb84-4749-ba86-d6dbe79d9e59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:28.320700 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a55205-eb84-4749-ba86-d6dbe79d9e59 None admin] RBAC: Adding query filter params (role.id=1b52a0b7aac8436d9924035295f57093, scope.project.id=dd1ea6c1f8214651a9e7c21e90adac21, user.id=05cfee04eb4e4df69861caa0326b4534) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:28.321103 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a55205-eb84-4749-ba86-d6dbe79d9e59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:28.322606 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a55205-eb84-4749-ba86-d6dbe79d9e59 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:28.329048 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 54/111] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 00:38:28 2022] GET /identity/v3/role_assignments?user.id=05cfee04eb4e4df69861caa0326b4534&scope.project.id=dd1ea6c1f8214651a9e7c21e90adac21&role.id=1b52a0b7aac8436d9924035295f57093 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:28.492587 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bfa33-6f9a-4509-bc33-61ff3f80af84 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:28.492930 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bfa33-6f9a-4509-bc33-61ff3f80af84 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:28.493099 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bfa33-6f9a-4509-bc33-61ff3f80af84 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:28.494599 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 58/112] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:28.501206 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe23e3b-e5c6-4918-8797-a6eab1aa8611 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:28.501531 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe23e3b-e5c6-4918-8797-a6eab1aa8611 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:28.501818 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe23e3b-e5c6-4918-8797-a6eab1aa8611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:28.525412 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-1fe23e3b-e5c6-4918-8797-a6eab1aa8611 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:28.526675 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-1fe23e3b-e5c6-4918-8797-a6eab1aa8611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:28.602909 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 55/113] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:28.653660 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469221c6-0e8b-4137-ae56-381ba10f6b5e None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:28.653971 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469221c6-0e8b-4137-ae56-381ba10f6b5e None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:28.654237 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469221c6-0e8b-4137-ae56-381ba10f6b5e None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:28.655620 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 59/114] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:28.661789 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c47305-b975-428a-a976-b4d5f28a8792 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:28.662085 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c47305-b975-428a-a976-b4d5f28a8792 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:28.662343 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c47305-b975-428a-a976-b4d5f28a8792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:28.692279 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-c1c47305-b975-428a-a976-b4d5f28a8792 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:28.693590 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-c1c47305-b975-428a-a976-b4d5f28a8792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:28.769918 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:28.783249 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469221c6-0e8b-4137-ae56-381ba10f6b5e None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:28.797987 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 56/115] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:28.836798 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:28.873117 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6240888-cc39-4746-9fcd-56abd5065b5a None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:28.873767 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6240888-cc39-4746-9fcd-56abd5065b5a None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:28.874317 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6240888-cc39-4746-9fcd-56abd5065b5a None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:28.875898 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 57/116] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:38:28.889145 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ac1f7-b3bb-4332-9b25-469e8feea1aa None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:28.889815 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ac1f7-b3bb-4332-9b25-469e8feea1aa None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:28.890317 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ac1f7-b3bb-4332-9b25-469e8feea1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:28.926432 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-f39ac1f7-b3bb-4332-9b25-469e8feea1aa None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:28.930671 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-f39ac1f7-b3bb-4332-9b25-469e8feea1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:28.995170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469221c6-0e8b-4137-ae56-381ba10f6b5e None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:29.072530 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 58/117] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:38:29.073333 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ac1f7-b3bb-4332-9b25-469e8feea1aa None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:29.080102 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda9d22-ac59-4967-8be8-862c559313b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:29.080751 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda9d22-ac59-4967-8be8-862c559313b6 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:29.081029 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda9d22-ac59-4967-8be8-862c559313b6 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:29.081303 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda9d22-ac59-4967-8be8-862c559313b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:29.101778 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda9d22-ac59-4967-8be8-862c559313b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:38:29.109656 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-5bda9d22-ac59-4967-8be8-862c559313b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:38:29.109656 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:29.109656 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:29.109656 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:29.109656 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:29.109656 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:29.109656 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:29.109656 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:29.109656 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:29.109656 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:29.109656 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:29.109656 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:29.109656 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:38:29.109656 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:38:29.109656 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:38:29.109656 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:38:29.110535 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:38:29.110535 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:38:29.110535 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:38:29.110535 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:38:29.110535 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:29.110535 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:29.110535 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:29.110535 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:29.110535 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:29.110535 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:29.110535 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:29.110535 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:29.110535 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:29.110535 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:29.110535 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:29.110535 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:29.112402 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:29.112402 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:29.112402 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:29.112402 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:29.112402 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:38:29.112402 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:38:29.112402 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:38:29.112402 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:38:29.112402 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:38:29.112402 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:38:29.112402 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:38:29.112402 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:38:29.112402 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 60/118] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:38:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:38:29.125164 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda9d22-ac59-4967-8be8-862c559313b6 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:29.342645 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:29.358651 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda9d22-ac59-4967-8be8-862c559313b6 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:29.388431 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ac1f7-b3bb-4332-9b25-469e8feea1aa None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:29.407351 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c18987-0440-4fff-b38d-56519fbb6aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:29.408004 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c18987-0440-4fff-b38d-56519fbb6aa1 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:29.408297 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c18987-0440-4fff-b38d-56519fbb6aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:29.408584 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c18987-0440-4fff-b38d-56519fbb6aa1 None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:29.409289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c18987-0440-4fff-b38d-56519fbb6aa1 None admin] RBAC: Adding query filter params (name=member) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:29.411368 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c18987-0440-4fff-b38d-56519fbb6aa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:29.412853 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c18987-0440-4fff-b38d-56519fbb6aa1 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:29.426996 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:29.430223 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 61/119] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 00:38:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:38:29.437003 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c18987-0440-4fff-b38d-56519fbb6aa1 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:29.469972 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94436a8-fbf2-4fc6-be5d-4eae70b32da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:29.470900 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94436a8-fbf2-4fc6-be5d-4eae70b32da9 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:29.471190 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94436a8-fbf2-4fc6-be5d-4eae70b32da9 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:29.471468 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94436a8-fbf2-4fc6-be5d-4eae70b32da9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:29.483399 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94436a8-fbf2-4fc6-be5d-4eae70b32da9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:38:29.488168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-d94436a8-fbf2-4fc6-be5d-4eae70b32da9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:38:29.488168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:29.488168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:29.488168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:29.488168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:29.488168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:29.488168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:29.488168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:29.488168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:29.488168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:29.488168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:29.488168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:29.488168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:38:29.488168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:38:29.488168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:38:29.488168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:38:29.488994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:38:29.488994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:38:29.488994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:38:29.488994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:38:29.488994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:29.488994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:29.488994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:29.488994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:29.488994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:29.488994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:29.488994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:29.488994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:29.488994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:29.488994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:29.488994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:29.488994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:29.490443 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:29.490443 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:29.490443 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:29.490443 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:29.490443 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:38:29.490443 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:38:29.490443 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:38:29.490443 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:38:29.490443 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:38:29.490443 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:38:29.490443 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:38:29.490443 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:38:29.490443 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 59/120] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 00:38:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:38:29.490443 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94436a8-fbf2-4fc6-be5d-4eae70b32da9 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:29.557257 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c18987-0440-4fff-b38d-56519fbb6aa1 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:29.601961 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5ed90-ca80-48c1-bfa4-18911cab793b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:29.603043 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5ed90-ca80-48c1-bfa4-18911cab793b None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:29.603445 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5ed90-ca80-48c1-bfa4-18911cab793b None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:29.603736 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5ed90-ca80-48c1-bfa4-18911cab793b None admin] PATH_INFO: `/v3/users/18e223919a594043ac62adff17d731d8` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:29.605427 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd5ed90-ca80-48c1-bfa4-18911cab793b None admin] RBAC: Authorizing `identity:get_user(user_id=18e223919a594043ac62adff17d731d8)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:29.605783 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94436a8-fbf2-4fc6-be5d-4eae70b32da9 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:29.606954 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd5ed90-ca80-48c1-bfa4-18911cab793b None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:29.609757 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 62/121] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:38:29 2022] GET /identity/v3/users/18e223919a594043ac62adff17d731d8 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:29.610544 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5ed90-ca80-48c1-bfa4-18911cab793b None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:29.639465 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:29.648729 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fea6a-51ee-4945-b70f-8dd2ba9715ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:29.649403 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fea6a-51ee-4945-b70f-8dd2ba9715ad None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:29.649692 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fea6a-51ee-4945-b70f-8dd2ba9715ad None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:29.650272 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fea6a-51ee-4945-b70f-8dd2ba9715ad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:29.662089 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173fea6a-51ee-4945-b70f-8dd2ba9715ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:38:29.667014 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-173fea6a-51ee-4945-b70f-8dd2ba9715ad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:38:29.667014 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:29.667014 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:29.667014 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:29.667014 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:29.667014 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:29.667014 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:29.667014 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:29.667014 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:29.667014 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:29.667014 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:29.667014 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:29.667014 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:38:29.667014 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:38:29.667014 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:38:29.667014 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:38:29.668939 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:38:29.668939 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:38:29.668939 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:38:29.668939 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:38:29.668939 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:29.668939 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:29.668939 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:29.668939 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:29.668939 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:29.668939 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:29.668939 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:29.668939 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:29.668939 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:29.668939 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:29.668939 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:29.668939 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:29.669990 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:29.669990 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:29.669990 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:29.669990 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:29.669990 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:38:29.669990 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:38:29.669990 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:38:29.669990 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:38:29.669990 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:38:29.669990 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:38:29.669990 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:38:29.669990 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:38:29.674560 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 60/122] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 00:38:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:38:29.676021 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fea6a-51ee-4945-b70f-8dd2ba9715ad None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:29.720019 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:29.735314 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5ed90-ca80-48c1-bfa4-18911cab793b None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:29.777469 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140b6fc-24ee-4267-8d13-9e8573b64916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:29.778905 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140b6fc-24ee-4267-8d13-9e8573b64916 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:29.779601 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140b6fc-24ee-4267-8d13-9e8573b64916 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:29.780063 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140b6fc-24ee-4267-8d13-9e8573b64916 None admin] PATH_INFO: `/v3/roles/member` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:29.796467 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2140b6fc-24ee-4267-8d13-9e8573b64916 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:38:29.800922 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fea6a-51ee-4945-b70f-8dd2ba9715ad None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:29.805149 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-2140b6fc-24ee-4267-8d13-9e8573b64916 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:38:29.805149 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:29.805149 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:29.805149 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:29.805149 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:29.805149 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:29.805149 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:29.805149 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:29.805149 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:29.805149 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:29.805149 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:29.805149 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:29.805149 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:38:29.805149 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:38:29.805149 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:38:29.805149 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:38:29.807162 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:38:29.807162 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:38:29.807162 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:38:29.807162 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:38:29.807162 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:29.807162 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:29.807162 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:29.807162 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:29.807162 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:29.807162 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:29.807162 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:29.807162 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:29.807162 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:29.807162 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:29.807162 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:29.807162 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:29.808969 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:29.808969 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:29.808969 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:29.808969 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:29.808969 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:38:29.808969 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:38:29.808969 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:38:29.808969 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:38:29.808969 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:38:29.808969 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:38:29.808969 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:38:29.808969 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:38:29.811601 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 63/123] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:38:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:38:29.812805 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140b6fc-24ee-4267-8d13-9e8573b64916 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:29.855269 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd73e83-36cf-4d86-b4ae-1cce6217dfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:29.855612 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd73e83-36cf-4d86-b4ae-1cce6217dfa8 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:29.855932 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd73e83-36cf-4d86-b4ae-1cce6217dfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:29.856428 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd73e83-36cf-4d86-b4ae-1cce6217dfa8 None admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:29.857266 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd73e83-36cf-4d86-b4ae-1cce6217dfa8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:29.857602 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd73e83-36cf-4d86-b4ae-1cce6217dfa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:29.859075 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd73e83-36cf-4d86-b4ae-1cce6217dfa8 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:29.875270 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 61/124] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:38:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:29.876042 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd73e83-36cf-4d86-b4ae-1cce6217dfa8 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:29.914491 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:29.947222 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140b6fc-24ee-4267-8d13-9e8573b64916 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:29.993598 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421e343-2e1e-41c6-a4b3-e2b65528736f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:29.994251 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421e343-2e1e-41c6-a4b3-e2b65528736f None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:29.994541 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421e343-2e1e-41c6-a4b3-e2b65528736f None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:29.994887 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421e343-2e1e-41c6-a4b3-e2b65528736f None admin] PATH_INFO: `/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:29.997241 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421e343-2e1e-41c6-a4b3-e2b65528736f None admin] RBAC: Authorizing `identity:get_project(project_id=dd1ea6c1f8214651a9e7c21e90adac21)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:29.999168 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421e343-2e1e-41c6-a4b3-e2b65528736f None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:30.001454 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 64/125] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:38:29 2022] GET /identity/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:30.002257 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421e343-2e1e-41c6-a4b3-e2b65528736f None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:30.018475 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:30.026964 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd73e83-36cf-4d86-b4ae-1cce6217dfa8 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:30.079344 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42fee01-5cfc-4958-bec6-4aa4f790e46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:30.080082 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fee01-5cfc-4958-bec6-4aa4f790e46b None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:30.080437 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fee01-5cfc-4958-bec6-4aa4f790e46b None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:30.080786 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fee01-5cfc-4958-bec6-4aa4f790e46b None admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:30.081879 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42fee01-5cfc-4958-bec6-4aa4f790e46b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:30.082265 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42fee01-5cfc-4958-bec6-4aa4f790e46b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:30.084591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42fee01-5cfc-4958-bec6-4aa4f790e46b None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:30.105759 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 62/126] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:38:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:30.107036 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42fee01-5cfc-4958-bec6-4aa4f790e46b None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:30.138604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421e343-2e1e-41c6-a4b3-e2b65528736f None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:30.189951 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293cf5b9-47b6-45eb-b483-43d069c73170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:30.191336 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cf5b9-47b6-45eb-b483-43d069c73170 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:30.192068 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cf5b9-47b6-45eb-b483-43d069c73170 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:30.192610 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cf5b9-47b6-45eb-b483-43d069c73170 None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:30.193794 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293cf5b9-47b6-45eb-b483-43d069c73170 None admin] RBAC: Adding query filter params (name=member) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:30.194818 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293cf5b9-47b6-45eb-b483-43d069c73170 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:30.196735 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293cf5b9-47b6-45eb-b483-43d069c73170 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:30.216219 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 65/127] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 00:38:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:30.224911 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293cf5b9-47b6-45eb-b483-43d069c73170 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:30.240289 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42fee01-5cfc-4958-bec6-4aa4f790e46b None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:30.245395 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:30.281419 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351b2a3-2cad-4ae2-a8bc-920e8f97a64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:30.282386 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351b2a3-2cad-4ae2-a8bc-920e8f97a64d None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:30.282851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351b2a3-2cad-4ae2-a8bc-920e8f97a64d None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:30.283306 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351b2a3-2cad-4ae2-a8bc-920e8f97a64d None admin] PATH_INFO: `/v3/users/a681f7ed1c9344b28a9297878afcbf46` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:30.284742 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351b2a3-2cad-4ae2-a8bc-920e8f97a64d None admin] RBAC: Authorizing `identity:get_user(user_id=a681f7ed1c9344b28a9297878afcbf46)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:30.286573 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351b2a3-2cad-4ae2-a8bc-920e8f97a64d None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:30.288448 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 63/128] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:38:30 2022] GET /identity/v3/users/a681f7ed1c9344b28a9297878afcbf46 => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:30.289563 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351b2a3-2cad-4ae2-a8bc-920e8f97a64d None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:30.323373 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:30.349204 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293cf5b9-47b6-45eb-b483-43d069c73170 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:30.390262 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee09c66-d2c4-4a43-b805-e4c419429a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:30.390970 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee09c66-d2c4-4a43-b805-e4c419429a31 None admin] REQUEST_METHOD: `PUT` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:30.391329 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee09c66-d2c4-4a43-b805-e4c419429a31 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:30.391683 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee09c66-d2c4-4a43-b805-e4c419429a31 None admin] PATH_INFO: `/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21/users/18e223919a594043ac62adff17d731d8/roles/64e752fa5df040c1a0b12914b5dacd49` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:30.394439 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee09c66-d2c4-4a43-b805-e4c419429a31 None admin] RBAC: Authorizing `identity:create_grant(project_id=dd1ea6c1f8214651a9e7c21e90adac21, user_id=18e223919a594043ac62adff17d731d8, role_id=64e752fa5df040c1a0b12914b5dacd49)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:30.396154 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee09c66-d2c4-4a43-b805-e4c419429a31 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:30.413565 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351b2a3-2cad-4ae2-a8bc-920e8f97a64d None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:30.454206 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003ebba-785b-496f-9c11-2719d77826bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:30.454855 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003ebba-785b-496f-9c11-2719d77826bf None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:30.455148 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003ebba-785b-496f-9c11-2719d77826bf None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:30.455434 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003ebba-785b-496f-9c11-2719d77826bf None admin] PATH_INFO: `/v3/users/18e223919a594043ac62adff17d731d8` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:30.456816 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7003ebba-785b-496f-9c11-2719d77826bf None admin] RBAC: Authorizing `identity:get_user(user_id=18e223919a594043ac62adff17d731d8)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:30.458313 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7003ebba-785b-496f-9c11-2719d77826bf None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:30.460083 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 64/129] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:38:30 2022] GET /identity/v3/users/18e223919a594043ac62adff17d731d8 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:30.460680 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003ebba-785b-496f-9c11-2719d77826bf None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:30.481717 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 66/130] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 00:38:30 2022] PUT /identity/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21/users/18e223919a594043ac62adff17d731d8/roles/64e752fa5df040c1a0b12914b5dacd49 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:30.482438 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee09c66-d2c4-4a43-b805-e4c419429a31 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:30.570524 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:30.620798 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee09c66-d2c4-4a43-b805-e4c419429a31 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:30.628274 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:30.638090 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003ebba-785b-496f-9c11-2719d77826bf None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:30.673802 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e16b5-3fbc-42ee-8dc7-48765876493f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:30.675222 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e16b5-3fbc-42ee-8dc7-48765876493f None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:30.675771 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e16b5-3fbc-42ee-8dc7-48765876493f None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:30.676047 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e16b5-3fbc-42ee-8dc7-48765876493f None admin] PATH_INFO: `/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:30.677405 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e16b5-3fbc-42ee-8dc7-48765876493f None admin] RBAC: Authorizing `identity:get_project(project_id=dd1ea6c1f8214651a9e7c21e90adac21)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:30.678915 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e16b5-3fbc-42ee-8dc7-48765876493f None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:30.680753 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 67/131] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:38:30 2022] GET /identity/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:30.681428 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e16b5-3fbc-42ee-8dc7-48765876493f None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:30.695344 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921197c-030d-4f0e-bbe2-90808402362f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:30.696299 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921197c-030d-4f0e-bbe2-90808402362f None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:30.696763 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921197c-030d-4f0e-bbe2-90808402362f None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:30.697899 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921197c-030d-4f0e-bbe2-90808402362f None admin] PATH_INFO: `/v3/users/18e223919a594043ac62adff17d731d8` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:30.700209 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921197c-030d-4f0e-bbe2-90808402362f None admin] RBAC: Authorizing `identity:get_user(user_id=18e223919a594043ac62adff17d731d8)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:30.702424 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921197c-030d-4f0e-bbe2-90808402362f None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:30.705221 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 65/132] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:38:30 2022] GET /identity/v3/users/18e223919a594043ac62adff17d731d8 => generated 275 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:30.706840 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635a9df-9792-4e78-8e4c-4df9892dd89e None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:30.707313 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635a9df-9792-4e78-8e4c-4df9892dd89e None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:30.707767 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635a9df-9792-4e78-8e4c-4df9892dd89e None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:30.709516 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 66/133] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:30.710392 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635a9df-9792-4e78-8e4c-4df9892dd89e None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:30.816298 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e16b5-3fbc-42ee-8dc7-48765876493f None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:30.849993 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635a9df-9792-4e78-8e4c-4df9892dd89e None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:30.853789 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690f2c0-48e5-4867-b156-cf562015aded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:30.854024 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690f2c0-48e5-4867-b156-cf562015aded None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:30.854442 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690f2c0-48e5-4867-b156-cf562015aded None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:30.854796 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690f2c0-48e5-4867-b156-cf562015aded None admin] PATH_INFO: `/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:30.856398 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690f2c0-48e5-4867-b156-cf562015aded None admin] RBAC: Authorizing `identity:get_project(project_id=dd1ea6c1f8214651a9e7c21e90adac21)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:30.857981 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690f2c0-48e5-4867-b156-cf562015aded None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:30.859822 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 68/134] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:38:30 2022] GET /identity/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:30.860628 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690f2c0-48e5-4867-b156-cf562015aded None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:30.864504 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:30.897273 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610102e-3d9b-46a7-8ca0-247bc17449e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:30.898463 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610102e-3d9b-46a7-8ca0-247bc17449e8 None admin] REQUEST_METHOD: `PUT` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:30.898833 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610102e-3d9b-46a7-8ca0-247bc17449e8 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:30.899178 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610102e-3d9b-46a7-8ca0-247bc17449e8 None admin] PATH_INFO: `/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21/users/a681f7ed1c9344b28a9297878afcbf46/roles/f13055bcebf847bf8b46160ded13810b` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:30.902518 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610102e-3d9b-46a7-8ca0-247bc17449e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=dd1ea6c1f8214651a9e7c21e90adac21, user_id=a681f7ed1c9344b28a9297878afcbf46, role_id=f13055bcebf847bf8b46160ded13810b)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:30.904545 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610102e-3d9b-46a7-8ca0-247bc17449e8 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:30.980665 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690f2c0-48e5-4867-b156-cf562015aded None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:31.007311 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 67/135] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 00:38:30 2022] PUT /identity/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21/users/a681f7ed1c9344b28a9297878afcbf46/roles/f13055bcebf847bf8b46160ded13810b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:31.011674 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003707d-0cf1-4b3c-873b-416af713541d None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:31.011674 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003707d-0cf1-4b3c-873b-416af713541d None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:31.011674 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003707d-0cf1-4b3c-873b-416af713541d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:31.039464 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc7bc3-26f0-4e07-8bfc-664928b26def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:31.040241 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc7bc3-26f0-4e07-8bfc-664928b26def None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:31.040403 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc7bc3-26f0-4e07-8bfc-664928b26def None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:31.040691 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc7bc3-26f0-4e07-8bfc-664928b26def None admin] PATH_INFO: `/v3/projects/a5e45241feaf4c72aea9f1e2d54098a0` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:31.042149 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc7bc3-26f0-4e07-8bfc-664928b26def None admin] RBAC: Authorizing `identity:get_project(project_id=a5e45241feaf4c72aea9f1e2d54098a0)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:31.044220 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc7bc3-26f0-4e07-8bfc-664928b26def None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:31.047723 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 69/136] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:38:30 2022] GET /identity/v3/projects/a5e45241feaf4c72aea9f1e2d54098a0 => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:31.052157 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc7bc3-26f0-4e07-8bfc-664928b26def None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:31.053475 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-c003707d-0cf1-4b3c-873b-416af713541d None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:31.055300 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-c003707d-0cf1-4b3c-873b-416af713541d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:31.092450 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:31.190804 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 68/137] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:31.197571 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003707d-0cf1-4b3c-873b-416af713541d None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:31.216135 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:31.272513 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc7bc3-26f0-4e07-8bfc-664928b26def None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:31.332707 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10574a-d072-41a6-9734-0de26e91afdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:31.333443 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10574a-d072-41a6-9734-0de26e91afdd None admin] REQUEST_METHOD: `PUT` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:31.333738 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10574a-d072-41a6-9734-0de26e91afdd None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:31.334200 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10574a-d072-41a6-9734-0de26e91afdd None admin] PATH_INFO: `/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21/users/18e223919a594043ac62adff17d731d8/roles/f0a369eda5014bb78b2d752c9abef48f` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:31.337005 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10574a-d072-41a6-9734-0de26e91afdd None admin] RBAC: Authorizing `identity:create_grant(project_id=dd1ea6c1f8214651a9e7c21e90adac21, user_id=18e223919a594043ac62adff17d731d8, role_id=f0a369eda5014bb78b2d752c9abef48f)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:31.339449 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10574a-d072-41a6-9734-0de26e91afdd None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:31.366631 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003707d-0cf1-4b3c-873b-416af713541d None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:31.436088 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 70/138] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 00:38:31 2022] PUT /identity/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21/users/18e223919a594043ac62adff17d731d8/roles/f0a369eda5014bb78b2d752c9abef48f => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:31.437616 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f3184-f0fa-4329-9b16-dadfea18c80d None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:31.438009 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f3184-f0fa-4329-9b16-dadfea18c80d None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:31.438296 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f3184-f0fa-4329-9b16-dadfea18c80d None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:31.441541 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 71/139] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:31.444257 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdfd157-fe8f-4c03-bb8c-dcd0b97bb775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:31.445049 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfd157-fe8f-4c03-bb8c-dcd0b97bb775 None admin] REQUEST_METHOD: `PUT` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:31.447339 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df5ee9-60c0-4684-adc9-ddfdf80aa2b5 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:31.447791 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df5ee9-60c0-4684-adc9-ddfdf80aa2b5 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:31.448158 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df5ee9-60c0-4684-adc9-ddfdf80aa2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:31.449555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfd157-fe8f-4c03-bb8c-dcd0b97bb775 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:31.451437 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfd157-fe8f-4c03-bb8c-dcd0b97bb775 None admin] PATH_INFO: `/v3/projects/a5e45241feaf4c72aea9f1e2d54098a0/users/18e223919a594043ac62adff17d731d8/roles/64e752fa5df040c1a0b12914b5dacd49` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:31.455571 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdfd157-fe8f-4c03-bb8c-dcd0b97bb775 None admin] RBAC: Authorizing `identity:create_grant(project_id=a5e45241feaf4c72aea9f1e2d54098a0, user_id=18e223919a594043ac62adff17d731d8, role_id=64e752fa5df040c1a0b12914b5dacd49)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:31.457555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdfd157-fe8f-4c03-bb8c-dcd0b97bb775 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:31.478933 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-18df5ee9-60c0-4684-adc9-ddfdf80aa2b5 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:31.481392 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-18df5ee9-60c0-4684-adc9-ddfdf80aa2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:31.544575 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 69/140] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 00:38:31 2022] PUT /identity/v3/projects/a5e45241feaf4c72aea9f1e2d54098a0/users/18e223919a594043ac62adff17d731d8/roles/64e752fa5df040c1a0b12914b5dacd49 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:31.566382 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdfd157-fe8f-4c03-bb8c-dcd0b97bb775 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:31.594591 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 72/141] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:38:31.599570 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:31.723373 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdfd157-fe8f-4c03-bb8c-dcd0b97bb775 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:31.765327 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6bebc9-5db5-44e1-82c0-4a33481106b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:31.766457 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bebc9-5db5-44e1-82c0-4a33481106b6 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:31.766953 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bebc9-5db5-44e1-82c0-4a33481106b6 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:31.767460 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bebc9-5db5-44e1-82c0-4a33481106b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:31.769131 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6bebc9-5db5-44e1-82c0-4a33481106b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:31.771029 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6bebc9-5db5-44e1-82c0-4a33481106b6 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:31.773236 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 70/142] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:38:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:31.780015 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df5ee9-60c0-4684-adc9-ddfdf80aa2b5 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:31.865781 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:31.919165 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df5ee9-60c0-4684-adc9-ddfdf80aa2b5 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:31.965804 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a033d-c0d3-4405-bed1-67b17688dd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:31.966428 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a033d-c0d3-4405-bed1-67b17688dd62 None admin] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:31.966714 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a033d-c0d3-4405-bed1-67b17688dd62 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:31.966993 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a033d-c0d3-4405-bed1-67b17688dd62 None admin] PATH_INFO: `/v3/users` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:31.967736 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a033d-c0d3-4405-bed1-67b17688dd62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:31.969209 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a033d-c0d3-4405-bed1-67b17688dd62 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:32.070474 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 73/143] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 26 00:38:31 2022] POST /identity/v3/users => generated 283 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:32.093704 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6bebc9-5db5-44e1-82c0-4a33481106b6 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:32.198386 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:32.223383 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6bebc9-5db5-44e1-82c0-4a33481106b6 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:32.274775 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdb931-8256-4eda-8d13-4919fa165c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:32.275439 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdb931-8256-4eda-8d13-4919fa165c8b None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:32.275727 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdb931-8256-4eda-8d13-4919fa165c8b None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:32.276007 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdb931-8256-4eda-8d13-4919fa165c8b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:32.289096 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fdb931-8256-4eda-8d13-4919fa165c8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:38:32.294849 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-16fdb931-8256-4eda-8d13-4919fa165c8b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:38:32.294849 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:32.294849 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:32.294849 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:32.294849 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:32.294849 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:32.294849 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:32.294849 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:32.294849 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:32.294849 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:32.294849 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:32.294849 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:32.294849 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:38:32.294849 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:38:32.294849 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:38:32.294849 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:38:32.295734 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:38:32.295734 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:38:32.295734 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:38:32.295734 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:38:32.295734 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:32.295734 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:32.295734 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:32.295734 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:32.295734 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:32.295734 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:32.295734 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:32.295734 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:32.295734 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:32.295734 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:32.295734 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:32.295734 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:32.296908 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:32.296908 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:32.296908 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:32.296908 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:32.296908 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:38:32.296908 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:38:32.296908 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:38:32.296908 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:38:32.296908 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:38:32.296908 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:38:32.296908 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:38:32.296908 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:38:32.296908 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 71/144] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:38:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:38:32.302252 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a033d-c0d3-4405-bed1-67b17688dd62 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:32.455891 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a033d-c0d3-4405-bed1-67b17688dd62 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:32.478932 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:32.512759 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083bed0-74fb-4bda-be2c-038500aaebcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:32.513415 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083bed0-74fb-4bda-be2c-038500aaebcc None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:32.513698 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083bed0-74fb-4bda-be2c-038500aaebcc None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:32.513984 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083bed0-74fb-4bda-be2c-038500aaebcc None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:32.514684 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083bed0-74fb-4bda-be2c-038500aaebcc None admin] RBAC: Adding query filter params (name=reader) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:32.515001 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083bed0-74fb-4bda-be2c-038500aaebcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:32.516416 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083bed0-74fb-4bda-be2c-038500aaebcc None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:32.530041 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 74/145] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 00:38:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:32.535833 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdb931-8256-4eda-8d13-4919fa165c8b None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:32.696359 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdb931-8256-4eda-8d13-4919fa165c8b None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:32.735994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95fdb8-d8c0-4573-a545-ebd9d3abafb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:32.736574 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95fdb8-d8c0-4573-a545-ebd9d3abafb5 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:32.736861 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95fdb8-d8c0-4573-a545-ebd9d3abafb5 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:32.737145 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95fdb8-d8c0-4573-a545-ebd9d3abafb5 None admin] PATH_INFO: `/v3/users/05cfee04eb4e4df69861caa0326b4534` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:32.738356 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95fdb8-d8c0-4573-a545-ebd9d3abafb5 None admin] RBAC: Authorizing `identity:get_user(user_id=05cfee04eb4e4df69861caa0326b4534)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:32.739957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95fdb8-d8c0-4573-a545-ebd9d3abafb5 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:32.745480 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 72/146] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:38:32 2022] GET /identity/v3/users/05cfee04eb4e4df69861caa0326b4534 => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:32.747633 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083bed0-74fb-4bda-be2c-038500aaebcc None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:32.877344 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083bed0-74fb-4bda-be2c-038500aaebcc None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:32.923219 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42d3c4-35d7-4b1f-b4bf-59fda794a03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:32.924227 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42d3c4-35d7-4b1f-b4bf-59fda794a03b None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:32.924716 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42d3c4-35d7-4b1f-b4bf-59fda794a03b None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:32.925664 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42d3c4-35d7-4b1f-b4bf-59fda794a03b None admin] PATH_INFO: `/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:32.927513 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42d3c4-35d7-4b1f-b4bf-59fda794a03b None admin] RBAC: Authorizing `identity:get_project(project_id=dd1ea6c1f8214651a9e7c21e90adac21)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:32.929189 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42d3c4-35d7-4b1f-b4bf-59fda794a03b None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:32.931451 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 75/147] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:38:32 2022] GET /identity/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:32.937807 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95fdb8-d8c0-4573-a545-ebd9d3abafb5 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:32.960233 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:33.085017 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95fdb8-d8c0-4573-a545-ebd9d3abafb5 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:33.143109 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5dd19e-fea9-4042-9d80-922fb8c371ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:33.143861 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dd19e-fea9-4042-9d80-922fb8c371ad None admin] REQUEST_METHOD: `PUT` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:33.149414 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dd19e-fea9-4042-9d80-922fb8c371ad None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:33.149414 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dd19e-fea9-4042-9d80-922fb8c371ad None admin] PATH_INFO: `/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21/users/05cfee04eb4e4df69861caa0326b4534/roles/1b52a0b7aac8436d9924035295f57093` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:33.149414 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5dd19e-fea9-4042-9d80-922fb8c371ad None admin] RBAC: Authorizing `identity:create_grant(project_id=dd1ea6c1f8214651a9e7c21e90adac21, user_id=05cfee04eb4e4df69861caa0326b4534, role_id=1b52a0b7aac8436d9924035295f57093)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:33.149414 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5dd19e-fea9-4042-9d80-922fb8c371ad None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:33.180679 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12670f2d-a2ba-4307-937c-c01c87db53a6 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:33.181660 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12670f2d-a2ba-4307-937c-c01c87db53a6 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:33.182157 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12670f2d-a2ba-4307-937c-c01c87db53a6 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:33.183775 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 76/148] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:38:33.189109 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebd30d-742c-4860-b23d-72bf85928f0e None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:33.189673 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebd30d-742c-4860-b23d-72bf85928f0e None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:33.190175 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebd30d-742c-4860-b23d-72bf85928f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:33.218739 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-a7ebd30d-742c-4860-b23d-72bf85928f0e None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:33.220318 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-a7ebd30d-742c-4860-b23d-72bf85928f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:33.279021 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:33.290733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 73/149] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 00:38:32 2022] PUT /identity/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21/users/05cfee04eb4e4df69861caa0326b4534/roles/1b52a0b7aac8436d9924035295f57093 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:33.311372 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 77/150] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:38:33.857168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5dd19e-fea9-4042-9d80-922fb8c371ad None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:33.935529 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:33.977006 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5dd19e-fea9-4042-9d80-922fb8c371ad None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:34.029260 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c9c69-d6b6-457f-83a4-73f4a9c50d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:34.029934 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c9c69-d6b6-457f-83a4-73f4a9c50d30 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:34.030217 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c9c69-d6b6-457f-83a4-73f4a9c50d30 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:34.030493 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c9c69-d6b6-457f-83a4-73f4a9c50d30 None admin] PATH_INFO: `/v3/roles/member` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:34.045745 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c9c69-d6b6-457f-83a4-73f4a9c50d30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:38:34.051059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-0d3c9c69-d6b6-457f-83a4-73f4a9c50d30 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:38:34.051059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:34.051059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:34.051059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:34.051059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:34.051059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:34.051059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:34.051059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:34.051059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:34.051059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:34.051059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:34.051059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:34.051059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:38:34.051059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:38:34.051059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:38:34.051059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:38:34.052095 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:38:34.052095 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:38:34.052095 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:38:34.052095 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:38:34.052095 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:34.052095 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:34.052095 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:34.052095 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:34.052095 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:34.052095 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:34.052095 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:34.052095 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:34.052095 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:34.052095 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:34.052095 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:34.052095 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:34.052982 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:34.052982 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:34.052982 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:34.052982 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:34.052982 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:38:34.052982 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:38:34.052982 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:38:34.052982 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:38:34.052982 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:38:34.052982 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:38:34.052982 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:38:34.052982 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:38:34.052982 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 74/151] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:38:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:38:34.059108 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebd30d-742c-4860-b23d-72bf85928f0e None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:34.215208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebd30d-742c-4860-b23d-72bf85928f0e None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:34.261057 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b730696-ed12-4aca-ba8e-57ba059c3988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:34.261724 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b730696-ed12-4aca-ba8e-57ba059c3988 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:34.262098 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b730696-ed12-4aca-ba8e-57ba059c3988 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:34.262319 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b730696-ed12-4aca-ba8e-57ba059c3988 None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:34.262954 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b730696-ed12-4aca-ba8e-57ba059c3988 None admin] RBAC: Adding query filter params (name=member) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:34.263264 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b730696-ed12-4aca-ba8e-57ba059c3988 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:34.264682 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b730696-ed12-4aca-ba8e-57ba059c3988 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:34.277504 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 78/152] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 00:38:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:34.281590 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c9c69-d6b6-457f-83a4-73f4a9c50d30 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:34.458965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c9c69-d6b6-457f-83a4-73f4a9c50d30 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:34.491489 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:34.501226 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4f544-62b2-49e0-ae23-3aa9728bb487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:34.501914 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4f544-62b2-49e0-ae23-3aa9728bb487 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:34.502199 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4f544-62b2-49e0-ae23-3aa9728bb487 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:34.507884 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4f544-62b2-49e0-ae23-3aa9728bb487 None admin] PATH_INFO: `/v3/users/18e223919a594043ac62adff17d731d8` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:34.507884 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4f544-62b2-49e0-ae23-3aa9728bb487 None admin] RBAC: Authorizing `identity:get_user(user_id=18e223919a594043ac62adff17d731d8)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:34.507884 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4f544-62b2-49e0-ae23-3aa9728bb487 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:34.509522 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 75/153] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:38:34 2022] GET /identity/v3/users/18e223919a594043ac62adff17d731d8 => generated 275 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:34.515303 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b730696-ed12-4aca-ba8e-57ba059c3988 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:34.590320 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:34.673253 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b730696-ed12-4aca-ba8e-57ba059c3988 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:34.718137 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0e75e-ac14-4ee0-ab7f-51c3c2bce8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:34.718768 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0e75e-ac14-4ee0-ab7f-51c3c2bce8fd None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:34.719053 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0e75e-ac14-4ee0-ab7f-51c3c2bce8fd None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:34.719346 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0e75e-ac14-4ee0-ab7f-51c3c2bce8fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:34.811551 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0e75e-ac14-4ee0-ab7f-51c3c2bce8fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:34.813043 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0e75e-ac14-4ee0-ab7f-51c3c2bce8fd None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:34.867453 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:34.971560 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 79/154] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:38:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:38:34.978520 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4f544-62b2-49e0-ae23-3aa9728bb487 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:35.212148 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4f544-62b2-49e0-ae23-3aa9728bb487 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:35.302580 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e12026-9348-4ece-bf41-85648a471d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:35.303677 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e12026-9348-4ece-bf41-85648a471d3c None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:35.304166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e12026-9348-4ece-bf41-85648a471d3c None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:35.304654 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e12026-9348-4ece-bf41-85648a471d3c None admin] PATH_INFO: `/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:35.306749 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e12026-9348-4ece-bf41-85648a471d3c None admin] RBAC: Authorizing `identity:get_project(project_id=dd1ea6c1f8214651a9e7c21e90adac21)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:35.309953 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e12026-9348-4ece-bf41-85648a471d3c None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:35.313105 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 76/155] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:38:34 2022] GET /identity/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21 => generated 298 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:35.321526 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0e75e-ac14-4ee0-ab7f-51c3c2bce8fd None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:35.412609 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a3c7e-c1eb-49f8-88c5-c360e2df8eec None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:35.413105 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a3c7e-c1eb-49f8-88c5-c360e2df8eec None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:35.413630 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a3c7e-c1eb-49f8-88c5-c360e2df8eec None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:35.416432 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 77/156] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:35.424082 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b8318-952a-41ee-9bb3-779d53ae0e17 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:35.424554 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b8318-952a-41ee-9bb3-779d53ae0e17 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:35.425038 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b8318-952a-41ee-9bb3-779d53ae0e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:35.482925 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0e75e-ac14-4ee0-ab7f-51c3c2bce8fd None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:35.483095 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-4e5b8318-952a-41ee-9bb3-779d53ae0e17 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:35.485041 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-4e5b8318-952a-41ee-9bb3-779d53ae0e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:35.570215 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10739dc-c52e-46aa-92c5-defdaa9fd476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:35.571086 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10739dc-c52e-46aa-92c5-defdaa9fd476 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:35.571381 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10739dc-c52e-46aa-92c5-defdaa9fd476 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:35.571669 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10739dc-c52e-46aa-92c5-defdaa9fd476 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:35.572431 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10739dc-c52e-46aa-92c5-defdaa9fd476 None admin] RBAC: Adding query filter params (role.id=64e752fa5df040c1a0b12914b5dacd49, scope.project.id=dd1ea6c1f8214651a9e7c21e90adac21, user.id=18e223919a594043ac62adff17d731d8) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:35.572752 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10739dc-c52e-46aa-92c5-defdaa9fd476 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:35.574935 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10739dc-c52e-46aa-92c5-defdaa9fd476 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:35.585796 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 80/157] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 00:38:35 2022] GET /identity/v3/role_assignments?user.id=18e223919a594043ac62adff17d731d8&scope.project.id=dd1ea6c1f8214651a9e7c21e90adac21&role.id=64e752fa5df040c1a0b12914b5dacd49 => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:35.587217 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb739f4-3933-4090-b50e-57ee28b662ca None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:35.587513 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb739f4-3933-4090-b50e-57ee28b662ca None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:35.587830 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb739f4-3933-4090-b50e-57ee28b662ca None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:35.589289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 81/158] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:35.590574 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904aa34d-22b6-4a4d-b4d9-2ae1b444a477 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:35.590859 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904aa34d-22b6-4a4d-b4d9-2ae1b444a477 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:35.591173 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904aa34d-22b6-4a4d-b4d9-2ae1b444a477 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:35.599036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 82/159] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:35 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:35.600258 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e51e2-9be4-4e63-adfb-2f891e77afe0 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:35.600547 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e51e2-9be4-4e63-adfb-2f891e77afe0 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:35.600875 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e51e2-9be4-4e63-adfb-2f891e77afe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:35.617798 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:35.638748 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-087e51e2-9be4-4e63-adfb-2f891e77afe0 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:35.640235 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-087e51e2-9be4-4e63-adfb-2f891e77afe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:35.644886 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:35.656384 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 78/160] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:38:35.657712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939c13f-de95-467c-9bbc-efe6497a1d72 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:35.658000 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939c13f-de95-467c-9bbc-efe6497a1d72 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:35.658278 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939c13f-de95-467c-9bbc-efe6497a1d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:35.691601 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-b939c13f-de95-467c-9bbc-efe6497a1d72 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:35.692822 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-b939c13f-de95-467c-9bbc-efe6497a1d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:35.787004 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 83/161] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:35.840163 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 79/162] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:36.461056 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e51e2-9be4-4e63-adfb-2f891e77afe0 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:36.475209 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939c13f-de95-467c-9bbc-efe6497a1d72 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:36.632890 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e51e2-9be4-4e63-adfb-2f891e77afe0 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:36.675611 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4be1a-d27c-4cc5-bcc7-4945c37829f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:36.676845 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4be1a-d27c-4cc5-bcc7-4945c37829f1 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:36.677333 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4be1a-d27c-4cc5-bcc7-4945c37829f1 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:36.677817 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4be1a-d27c-4cc5-bcc7-4945c37829f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:36.689878 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4be1a-d27c-4cc5-bcc7-4945c37829f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:38:36.698223 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:36.700613 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-3cb4be1a-d27c-4cc5-bcc7-4945c37829f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:38:36.700613 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:36.700613 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:36.700613 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:36.700613 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:36.700613 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:36.700613 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:36.700613 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:36.700613 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:36.700613 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:36.700613 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:36.700613 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:36.700613 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:38:36.700613 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:38:36.700613 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:38:36.700613 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:38:36.701479 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:38:36.701479 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:38:36.701479 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:38:36.701479 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:38:36.701479 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:36.701479 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:36.701479 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:36.701479 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:36.701479 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:36.701479 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:36.701479 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:36.701479 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:36.701479 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:36.701479 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:36.701479 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:36.701479 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:36.702240 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:36.702240 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:36.702240 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:36.702240 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:36.702240 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:38:36.702240 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:38:36.702240 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:38:36.702240 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:38:36.702240 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:38:36.702240 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:38:36.702240 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:38:36.702240 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:38:36.702938 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 84/163] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 00:38:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:38:36.703440 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4be1a-d27c-4cc5-bcc7-4945c37829f1 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:36.719548 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939c13f-de95-467c-9bbc-efe6497a1d72 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:36.746963 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:36.756975 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4902d-80da-4f59-8381-8c6708980cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:36.757862 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4902d-80da-4f59-8381-8c6708980cab None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:36.758288 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4902d-80da-4f59-8381-8c6708980cab None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:36.758706 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4902d-80da-4f59-8381-8c6708980cab None admin] PATH_INFO: `/v3/roles/member` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:36.770668 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4902d-80da-4f59-8381-8c6708980cab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:38:36.775550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-68b4902d-80da-4f59-8381-8c6708980cab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:38:36.775550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:36.775550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:36.775550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:36.775550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:36.775550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:36.775550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:36.775550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:36.775550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:36.775550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:36.775550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:36.775550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:36.775550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:38:36.775550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:38:36.775550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:38:36.775550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:38:36.776452 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:38:36.776452 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:38:36.776452 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:38:36.776452 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:38:36.776452 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:36.776452 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:36.776452 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:36.776452 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:36.776452 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:36.776452 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:36.776452 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:36.776452 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:36.776452 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:36.776452 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:36.776452 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:36.776452 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:36.777800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:36.777800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:36.777800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:36.777800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:36.777800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:38:36.777800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:38:36.777800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:38:36.777800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:38:36.777800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:38:36.777800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:38:36.777800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:38:36.777800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:38:36.777800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 80/164] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:38:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:38:36.778982 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4902d-80da-4f59-8381-8c6708980cab None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:36.896210 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4be1a-d27c-4cc5-bcc7-4945c37829f1 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:36.967969 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4902d-80da-4f59-8381-8c6708980cab None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:36.973012 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba5eb7-58cc-436f-bd9b-e85617f647d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:36.974057 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba5eb7-58cc-436f-bd9b-e85617f647d7 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:36.974753 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba5eb7-58cc-436f-bd9b-e85617f647d7 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:36.975239 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba5eb7-58cc-436f-bd9b-e85617f647d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:37.012767 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba5eb7-58cc-436f-bd9b-e85617f647d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:38:37.022517 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-c8ba5eb7-58cc-436f-bd9b-e85617f647d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:38:37.022517 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:37.022517 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:37.022517 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:37.022517 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:37.022517 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:37.022517 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:37.022517 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:37.022517 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:37.022517 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:37.022517 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:37.022517 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:37.022517 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:38:37.022517 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:38:37.022517 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:38:37.022517 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:38:37.023501 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:38:37.023501 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:38:37.023501 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:38:37.023501 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:38:37.023501 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:37.023501 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:37.023501 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:37.023501 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:37.023501 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:37.023501 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:37.023501 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:37.023501 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:37.023501 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:37.023501 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:37.023501 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:37.023501 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:37.024322 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:37.024322 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:37.024322 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:37.024322 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:37.024322 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:38:37.024322 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:38:37.024322 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:38:37.024322 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:38:37.024322 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:38:37.024322 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:38:37.024322 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:38:37.024322 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:38:37.027186 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356881b-2707-4a5a-a067-83857b3a7b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:37.033710 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 85/165] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 00:38:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:38:37.033710 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba5eb7-58cc-436f-bd9b-e85617f647d7 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:37.035094 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356881b-2707-4a5a-a067-83857b3a7b8c None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:37.035593 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356881b-2707-4a5a-a067-83857b3a7b8c None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:37.036068 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356881b-2707-4a5a-a067-83857b3a7b8c None admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:37.036993 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356881b-2707-4a5a-a067-83857b3a7b8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:37.037537 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356881b-2707-4a5a-a067-83857b3a7b8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:37.039316 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356881b-2707-4a5a-a067-83857b3a7b8c None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:37.058438 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 81/166] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:38:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:37.059666 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356881b-2707-4a5a-a067-83857b3a7b8c None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:37.145518 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:37.199291 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356881b-2707-4a5a-a067-83857b3a7b8c None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:37.238038 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413403f-79fd-45cf-8768-5672d0444fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:37.238888 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413403f-79fd-45cf-8768-5672d0444fc3 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:37.239301 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413403f-79fd-45cf-8768-5672d0444fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:37.239706 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413403f-79fd-45cf-8768-5672d0444fc3 None admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:37.240594 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413403f-79fd-45cf-8768-5672d0444fc3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:37.241238 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413403f-79fd-45cf-8768-5672d0444fc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:37.245863 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:37.248148 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413403f-79fd-45cf-8768-5672d0444fc3 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:37.265950 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 82/167] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:38:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:37.267166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413403f-79fd-45cf-8768-5672d0444fc3 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:37.304186 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba5eb7-58cc-436f-bd9b-e85617f647d7 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:37.408696 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07757de3-9e54-444e-9502-93bea9c41b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:37.410601 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07757de3-9e54-444e-9502-93bea9c41b66 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:37.411815 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07757de3-9e54-444e-9502-93bea9c41b66 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:37.412446 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07757de3-9e54-444e-9502-93bea9c41b66 None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:37.414789 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07757de3-9e54-444e-9502-93bea9c41b66 None admin] RBAC: Adding query filter params (name=member) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:37.415306 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07757de3-9e54-444e-9502-93bea9c41b66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:37.417902 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07757de3-9e54-444e-9502-93bea9c41b66 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:37.431190 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 86/168] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 00:38:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:37.432535 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07757de3-9e54-444e-9502-93bea9c41b66 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:37.529652 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413403f-79fd-45cf-8768-5672d0444fc3 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:37.551317 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:37.590774 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07757de3-9e54-444e-9502-93bea9c41b66 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:37.611022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:37.643631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487d15e-cafa-4814-bc81-413acb0636c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:37.644704 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487d15e-cafa-4814-bc81-413acb0636c8 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:37.645145 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487d15e-cafa-4814-bc81-413acb0636c8 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:37.645584 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487d15e-cafa-4814-bc81-413acb0636c8 None admin] PATH_INFO: `/v3/users/18e223919a594043ac62adff17d731d8` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:37.646289 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462f4ce-60b4-45d8-a173-34b376378608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:37.646930 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487d15e-cafa-4814-bc81-413acb0636c8 None admin] RBAC: Authorizing `identity:get_user(user_id=18e223919a594043ac62adff17d731d8)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:37.647242 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462f4ce-60b4-45d8-a173-34b376378608 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:37.647599 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462f4ce-60b4-45d8-a173-34b376378608 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:37.647945 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462f4ce-60b4-45d8-a173-34b376378608 None admin] PATH_INFO: `/v3/users/a681f7ed1c9344b28a9297878afcbf46` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:37.649057 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487d15e-cafa-4814-bc81-413acb0636c8 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:37.649309 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462f4ce-60b4-45d8-a173-34b376378608 None admin] RBAC: Authorizing `identity:get_user(user_id=a681f7ed1c9344b28a9297878afcbf46)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:37.651120 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 87/169] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:38:37 2022] GET /identity/v3/users/18e223919a594043ac62adff17d731d8 => generated 275 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:37.651423 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462f4ce-60b4-45d8-a173-34b376378608 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:37.653060 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487d15e-cafa-4814-bc81-413acb0636c8 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:37.662429 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 83/170] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:38:37 2022] GET /identity/v3/users/a681f7ed1c9344b28a9297878afcbf46 => generated 247 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:37.663698 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e67a69-c502-4f6e-90a3-ae6e51541710 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:37.663992 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e67a69-c502-4f6e-90a3-ae6e51541710 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:37.664276 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e67a69-c502-4f6e-90a3-ae6e51541710 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:37.665747 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 84/171] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:37.666506 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e67a69-c502-4f6e-90a3-ae6e51541710 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:37.796899 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487d15e-cafa-4814-bc81-413acb0636c8 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:37.838721 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72a329-2ac5-4a93-b6f0-a27fccd0ea8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:37.840384 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72a329-2ac5-4a93-b6f0-a27fccd0ea8b None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:37.840957 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72a329-2ac5-4a93-b6f0-a27fccd0ea8b None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:37.841514 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72a329-2ac5-4a93-b6f0-a27fccd0ea8b None admin] PATH_INFO: `/v3/users/18e223919a594043ac62adff17d731d8` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:37.843116 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec72a329-2ac5-4a93-b6f0-a27fccd0ea8b None admin] RBAC: Authorizing `identity:get_user(user_id=18e223919a594043ac62adff17d731d8)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:37.845026 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec72a329-2ac5-4a93-b6f0-a27fccd0ea8b None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:37.847219 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 88/172] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:38:37 2022] GET /identity/v3/users/18e223919a594043ac62adff17d731d8 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:37.848323 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72a329-2ac5-4a93-b6f0-a27fccd0ea8b None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:37.882575 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e67a69-c502-4f6e-90a3-ae6e51541710 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:37.911885 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:37.929831 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c148c6-a7d0-4845-9be9-a28ae7aeb70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:37.930494 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c148c6-a7d0-4845-9be9-a28ae7aeb70e None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:37.930775 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c148c6-a7d0-4845-9be9-a28ae7aeb70e None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:37.931051 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c148c6-a7d0-4845-9be9-a28ae7aeb70e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:37.968955 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72a329-2ac5-4a93-b6f0-a27fccd0ea8b None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:37.991408 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:38.012093 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02719490-ede3-4655-8f6a-88a452f86226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:38.012737 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02719490-ede3-4655-8f6a-88a452f86226 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:38.013020 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02719490-ede3-4655-8f6a-88a452f86226 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:38.013303 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02719490-ede3-4655-8f6a-88a452f86226 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:38.021560 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c148c6-a7d0-4845-9be9-a28ae7aeb70e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:38.023907 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c148c6-a7d0-4845-9be9-a28ae7aeb70e None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:38.092779 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02719490-ede3-4655-8f6a-88a452f86226 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:38.094213 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02719490-ede3-4655-8f6a-88a452f86226 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:38.157938 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:38.167914 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 85/173] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:38:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:38:38.167914 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcab736-b847-4486-b638-2dc350034938 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:38.167914 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcab736-b847-4486-b638-2dc350034938 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:38.167914 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcab736-b847-4486-b638-2dc350034938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:38.185169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-8bcab736-b847-4486-b638-2dc350034938 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:38.186437 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-8bcab736-b847-4486-b638-2dc350034938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:38.215994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 89/174] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:38:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:38:38.216985 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688c8a8-25a1-4ac0-b812-f5a7e35ae8e6 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:38.217272 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688c8a8-25a1-4ac0-b812-f5a7e35ae8e6 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:38.217675 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688c8a8-25a1-4ac0-b812-f5a7e35ae8e6 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:38.219239 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 90/175] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:38.220014 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688c8a8-25a1-4ac0-b812-f5a7e35ae8e6 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:38.263900 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 86/176] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:38.265195 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350a80f-360b-4494-9e77-017605c8e2d0 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:38.265513 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350a80f-360b-4494-9e77-017605c8e2d0 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:38.265794 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350a80f-360b-4494-9e77-017605c8e2d0 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:38.267365 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 87/177] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:38.268471 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e620bd-2cc5-4af0-9aa3-36a462fbed03 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:38.268753 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e620bd-2cc5-4af0-9aa3-36a462fbed03 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:38.269034 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e620bd-2cc5-4af0-9aa3-36a462fbed03 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:38.270550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 88/178] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:38.271515 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e620bd-2cc5-4af0-9aa3-36a462fbed03 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:38.290747 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:38.340854 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688c8a8-25a1-4ac0-b812-f5a7e35ae8e6 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:38.378540 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462a703-b65c-4a6a-b807-24e96847d6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:38.379117 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462a703-b65c-4a6a-b807-24e96847d6ea None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:38.379345 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462a703-b65c-4a6a-b807-24e96847d6ea None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:38.379607 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462a703-b65c-4a6a-b807-24e96847d6ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:38.397991 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e620bd-2cc5-4af0-9aa3-36a462fbed03 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:38.406363 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:38.438713 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa3e37-86b3-4562-8640-c1a47d02cbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:38.439350 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa3e37-86b3-4562-8640-c1a47d02cbf7 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:38.439698 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa3e37-86b3-4562-8640-c1a47d02cbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:38.439979 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa3e37-86b3-4562-8640-c1a47d02cbf7 None admin] PATH_INFO: `/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:38.441121 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa3e37-86b3-4562-8640-c1a47d02cbf7 None admin] RBAC: Authorizing `identity:get_project(project_id=dd1ea6c1f8214651a9e7c21e90adac21)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:38.442631 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa3e37-86b3-4562-8640-c1a47d02cbf7 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:38.444573 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 89/179] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:38:38 2022] GET /identity/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:38.445142 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa3e37-86b3-4562-8640-c1a47d02cbf7 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:38.465657 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462a703-b65c-4a6a-b807-24e96847d6ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:38.467557 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462a703-b65c-4a6a-b807-24e96847d6ea None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:38.540898 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:38.570323 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa3e37-86b3-4562-8640-c1a47d02cbf7 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:38.586479 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 91/180] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:38:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:38:38.592817 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41025e00-9f09-44f7-85e2-701ef81fdb6a None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:38.593433 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41025e00-9f09-44f7-85e2-701ef81fdb6a None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:38.593433 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41025e00-9f09-44f7-85e2-701ef81fdb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:38.612491 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-41025e00-9f09-44f7-85e2-701ef81fdb6a None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:38.613788 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-41025e00-9f09-44f7-85e2-701ef81fdb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:38.615052 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24687836-b308-45f8-b1eb-1b0b486e81a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:38.615700 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24687836-b308-45f8-b1eb-1b0b486e81a8 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:38.615988 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24687836-b308-45f8-b1eb-1b0b486e81a8 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:38.616261 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24687836-b308-45f8-b1eb-1b0b486e81a8 None admin] PATH_INFO: `/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:38.617438 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24687836-b308-45f8-b1eb-1b0b486e81a8 None admin] RBAC: Authorizing `identity:get_project(project_id=dd1ea6c1f8214651a9e7c21e90adac21)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:38.618897 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24687836-b308-45f8-b1eb-1b0b486e81a8 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:38.621166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 90/181] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:38:38 2022] GET /identity/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:38.622387 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7d2f3-1527-41df-b24b-ca25cb385eb3 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:38.622733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7d2f3-1527-41df-b24b-ca25cb385eb3 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:38.622927 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7d2f3-1527-41df-b24b-ca25cb385eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:38.642258 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-b3e7d2f3-1527-41df-b24b-ca25cb385eb3 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:38.643430 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-b3e7d2f3-1527-41df-b24b-ca25cb385eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:38.670779 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:38.694002 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 92/182] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:38.695099 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d32278-d25c-444e-af1c-caf0a3b744be None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:38.695391 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d32278-d25c-444e-af1c-caf0a3b744be None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:38.695668 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d32278-d25c-444e-af1c-caf0a3b744be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:38.717269 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-48d32278-d25c-444e-af1c-caf0a3b744be None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:38.718668 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-48d32278-d25c-444e-af1c-caf0a3b744be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:38.725685 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 91/183] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:38.726567 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7d2f3-1527-41df-b24b-ca25cb385eb3 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:38.832710 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 93/184] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:38.833436 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d32278-d25c-444e-af1c-caf0a3b744be None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:38.845991 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:38.893258 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7d2f3-1527-41df-b24b-ca25cb385eb3 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:38.930607 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bdf10-d4dc-4c14-bdd6-4b7d1c0bfbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:38.931587 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bdf10-d4dc-4c14-bdd6-4b7d1c0bfbd2 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:38.931973 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bdf10-d4dc-4c14-bdd6-4b7d1c0bfbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:38.932370 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bdf10-d4dc-4c14-bdd6-4b7d1c0bfbd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:38.933801 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865bdf10-d4dc-4c14-bdd6-4b7d1c0bfbd2 None admin] RBAC: Adding query filter params (role.id=f0a369eda5014bb78b2d752c9abef48f, scope.project.id=dd1ea6c1f8214651a9e7c21e90adac21, user.id=18e223919a594043ac62adff17d731d8) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:38.934284 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865bdf10-d4dc-4c14-bdd6-4b7d1c0bfbd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:38.935989 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865bdf10-d4dc-4c14-bdd6-4b7d1c0bfbd2 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:38.943856 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 92/185] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 00:38:38 2022] GET /identity/v3/role_assignments?user.id=18e223919a594043ac62adff17d731d8&scope.project.id=dd1ea6c1f8214651a9e7c21e90adac21&role.id=f0a369eda5014bb78b2d752c9abef48f => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:38.944822 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bdf10-d4dc-4c14-bdd6-4b7d1c0bfbd2 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:38.989814 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d32278-d25c-444e-af1c-caf0a3b744be None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:39.009512 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:39.035834 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c3c6d-7a82-4189-b674-184adb2e74ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:39.036870 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c3c6d-7a82-4189-b674-184adb2e74ad None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:39.037407 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c3c6d-7a82-4189-b674-184adb2e74ad None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:39.037962 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c3c6d-7a82-4189-b674-184adb2e74ad None admin] PATH_INFO: `/v3/projects/a5e45241feaf4c72aea9f1e2d54098a0` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:39.039707 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c3c6d-7a82-4189-b674-184adb2e74ad None admin] RBAC: Authorizing `identity:get_project(project_id=a5e45241feaf4c72aea9f1e2d54098a0)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:39.041716 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c3c6d-7a82-4189-b674-184adb2e74ad None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:39.044200 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 94/186] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:38:38 2022] GET /identity/v3/projects/a5e45241feaf4c72aea9f1e2d54098a0 => generated 312 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:39.045529 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c3c6d-7a82-4189-b674-184adb2e74ad None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:39.067923 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bdf10-d4dc-4c14-bdd6-4b7d1c0bfbd2 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:39.109703 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117736b-5669-4631-9ccc-42531d90cfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:39.110344 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117736b-5669-4631-9ccc-42531d90cfa9 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:39.110633 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117736b-5669-4631-9ccc-42531d90cfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:39.110908 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117736b-5669-4631-9ccc-42531d90cfa9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:39.114207 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:39.125586 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f117736b-5669-4631-9ccc-42531d90cfa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:38:39.130793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-f117736b-5669-4631-9ccc-42531d90cfa9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:38:39.130793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:39.130793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:39.130793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:39.130793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:39.130793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:39.130793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:39.130793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:39.130793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:39.130793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:39.130793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:39.130793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:39.130793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:38:39.130793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:38:39.130793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:38:39.130793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:38:39.131706 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:38:39.131706 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:38:39.131706 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:38:39.131706 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:38:39.131706 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:39.131706 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:39.131706 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:39.131706 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:39.131706 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:39.131706 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:39.131706 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:39.131706 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:39.131706 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:39.131706 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:39.131706 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:39.131706 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:39.132468 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:39.132468 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:39.132468 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:39.132468 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:39.132468 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:38:39.132468 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:38:39.132468 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:38:39.132468 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:38:39.132468 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:38:39.132468 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:38:39.132468 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:38:39.132468 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:38:39.132468 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 93/187] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 00:38:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:38:39.133134 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117736b-5669-4631-9ccc-42531d90cfa9 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:39.203954 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c3c6d-7a82-4189-b674-184adb2e74ad None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:39.279438 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f965e-7574-40da-8d89-9c951597c57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:39.280098 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f965e-7574-40da-8d89-9c951597c57e None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:39.280384 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f965e-7574-40da-8d89-9c951597c57e None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:39.280663 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f965e-7574-40da-8d89-9c951597c57e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:39.281460 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f965e-7574-40da-8d89-9c951597c57e None admin] RBAC: Adding query filter params (role.id=f13055bcebf847bf8b46160ded13810b, scope.project.id=dd1ea6c1f8214651a9e7c21e90adac21, user.id=a681f7ed1c9344b28a9297878afcbf46) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:39.281780 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f965e-7574-40da-8d89-9c951597c57e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:39.283288 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f965e-7574-40da-8d89-9c951597c57e None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:39.297129 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 95/188] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 00:38:39 2022] GET /identity/v3/role_assignments?user.id=a681f7ed1c9344b28a9297878afcbf46&scope.project.id=dd1ea6c1f8214651a9e7c21e90adac21&role.id=f13055bcebf847bf8b46160ded13810b => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:39.298474 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f965e-7574-40da-8d89-9c951597c57e None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:39.375655 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:39.430371 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117736b-5669-4631-9ccc-42531d90cfa9 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:39.479036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f965e-7574-40da-8d89-9c951597c57e None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:39.484123 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb7563-0359-4a5b-ac37-ca1763ac6987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:39.484768 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb7563-0359-4a5b-ac37-ca1763ac6987 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:39.485101 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb7563-0359-4a5b-ac37-ca1763ac6987 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:39.485421 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb7563-0359-4a5b-ac37-ca1763ac6987 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:39.486178 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb7563-0359-4a5b-ac37-ca1763ac6987 None admin] RBAC: Adding query filter params (role.id=64e752fa5df040c1a0b12914b5dacd49, scope.project.id=a5e45241feaf4c72aea9f1e2d54098a0, user.id=18e223919a594043ac62adff17d731d8) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:39.486495 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb7563-0359-4a5b-ac37-ca1763ac6987 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:39.488785 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb7563-0359-4a5b-ac37-ca1763ac6987 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:39.504139 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 94/189] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 00:38:39 2022] GET /identity/v3/role_assignments?user.id=18e223919a594043ac62adff17d731d8&scope.project.id=a5e45241feaf4c72aea9f1e2d54098a0&role.id=64e752fa5df040c1a0b12914b5dacd49 => generated 608 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:39.504139 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb7563-0359-4a5b-ac37-ca1763ac6987 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:39.534199 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cade21-b729-4abc-a584-dc48e601b873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:39.534928 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cade21-b729-4abc-a584-dc48e601b873 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:39.535203 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cade21-b729-4abc-a584-dc48e601b873 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:39.535662 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cade21-b729-4abc-a584-dc48e601b873 None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:39.536187 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cade21-b729-4abc-a584-dc48e601b873 None admin] RBAC: Adding query filter params (name=admin) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:39.536495 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cade21-b729-4abc-a584-dc48e601b873 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:39.538266 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cade21-b729-4abc-a584-dc48e601b873 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:39.551697 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 96/190] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:38:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:39.552586 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cade21-b729-4abc-a584-dc48e601b873 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:39.602667 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:39.689691 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb7563-0359-4a5b-ac37-ca1763ac6987 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:39.721805 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cade21-b729-4abc-a584-dc48e601b873 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:39.732291 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:39.747109 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc00a28-6a9c-482e-aec8-3de7d7c8d687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:39.748304 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc00a28-6a9c-482e-aec8-3de7d7c8d687 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:39.748806 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc00a28-6a9c-482e-aec8-3de7d7c8d687 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:39.749313 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc00a28-6a9c-482e-aec8-3de7d7c8d687 None admin] PATH_INFO: `/v3/domains/default` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:39.754099 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc00a28-6a9c-482e-aec8-3de7d7c8d687 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:39.756567 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc00a28-6a9c-482e-aec8-3de7d7c8d687 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:39.759103 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 95/191] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:38:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:39.759977 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc00a28-6a9c-482e-aec8-3de7d7c8d687 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:39.771344 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1898ed5-1d36-4ef1-92c0-dbec86ee0167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:39.774642 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1898ed5-1d36-4ef1-92c0-dbec86ee0167 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:39.774642 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1898ed5-1d36-4ef1-92c0-dbec86ee0167 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:39.774642 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1898ed5-1d36-4ef1-92c0-dbec86ee0167 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:39.787403 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1898ed5-1d36-4ef1-92c0-dbec86ee0167 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:38:39.793358 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-c1898ed5-1d36-4ef1-92c0-dbec86ee0167 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:38:39.793358 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:39.793358 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:39.793358 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:39.793358 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:39.793358 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:39.793358 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:39.793358 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:39.793358 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:39.793358 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:39.793358 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:39.793358 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:39.793358 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:38:39.793358 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:38:39.793358 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:38:39.793358 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:38:39.794580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:38:39.794580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:38:39.794580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:38:39.794580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:38:39.794580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:39.794580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:39.794580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:39.794580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:39.794580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:39.794580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:39.794580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:39.794580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:39.794580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:39.794580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:39.794580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:39.794580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:39.795341 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:39.795341 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:39.795341 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:39.795341 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:39.795341 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:38:39.795341 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:38:39.795341 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:38:39.795341 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:38:39.795341 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:38:39.795341 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:38:39.795341 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:38:39.795341 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:38:39.795915 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 97/192] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:38:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:38:39.797045 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1898ed5-1d36-4ef1-92c0-dbec86ee0167 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:39.894996 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc00a28-6a9c-482e-aec8-3de7d7c8d687 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:39.903670 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1898ed5-1d36-4ef1-92c0-dbec86ee0167 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:39.926776 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:39.936618 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bab2ed-6939-480d-b916-2bb8da42e74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:39.938808 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bab2ed-6939-480d-b916-2bb8da42e74f None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:39.938808 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bab2ed-6939-480d-b916-2bb8da42e74f None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:39.938808 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bab2ed-6939-480d-b916-2bb8da42e74f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:39.947868 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842e418-9727-4b3b-8e4f-434c02fc799e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:39.948253 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842e418-9727-4b3b-8e4f-434c02fc799e None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:39.948606 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842e418-9727-4b3b-8e4f-434c02fc799e None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:39.949414 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842e418-9727-4b3b-8e4f-434c02fc799e None admin] PATH_INFO: `/v3/users/d6c54fc2c7484b03b985896b2bcaa1ea` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:39.956391 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bab2ed-6939-480d-b916-2bb8da42e74f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:38:39.961164 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-41bab2ed-6939-480d-b916-2bb8da42e74f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:38:39.961164 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:39.961164 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:39.961164 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:39.961164 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:39.961164 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:39.961164 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:39.961164 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:39.961164 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:39.961164 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:39.961164 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:39.961164 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:39.961164 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:38:39.961164 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:38:39.961164 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:38:39.961164 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:38:39.962239 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:38:39.962239 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:38:39.962239 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:38:39.962239 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:38:39.962239 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:39.962239 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:39.962239 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:39.962239 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:39.962239 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:39.962239 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:39.962239 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:39.962239 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:39.962239 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:39.962239 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:39.962239 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:39.962239 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:39.963047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:39.963047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:39.963047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:39.963047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:39.963047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:38:39.963047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:38:39.963047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:38:39.963047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:38:39.963047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:38:39.963047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:38:39.963047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:38:39.963047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:38:39.963047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 96/193] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 00:38:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:38:39.963716 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bab2ed-6939-480d-b916-2bb8da42e74f None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:39.965970 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842e418-9727-4b3b-8e4f-434c02fc799e None admin] RBAC: Authorizing `identity:get_user(user_id=d6c54fc2c7484b03b985896b2bcaa1ea)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:39.967558 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842e418-9727-4b3b-8e4f-434c02fc799e None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:39.969754 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 98/194] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:38:39 2022] GET /identity/v3/users/d6c54fc2c7484b03b985896b2bcaa1ea => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:39.970657 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842e418-9727-4b3b-8e4f-434c02fc799e None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:40.000469 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:40.080987 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bab2ed-6939-480d-b916-2bb8da42e74f None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:40.097420 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842e418-9727-4b3b-8e4f-434c02fc799e None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:40.118115 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6db55f-e0d3-4e61-b58f-7a758700edcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:40.118727 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6db55f-e0d3-4e61-b58f-7a758700edcc None admin] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:40.119009 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6db55f-e0d3-4e61-b58f-7a758700edcc None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:40.119404 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6db55f-e0d3-4e61-b58f-7a758700edcc None admin] PATH_INFO: `/v3/users` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:40.120003 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6db55f-e0d3-4e61-b58f-7a758700edcc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:40.122641 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6db55f-e0d3-4e61-b58f-7a758700edcc None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:40.136779 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9882c7-6896-4d5e-b567-ddb0c654f61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:40.137459 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9882c7-6896-4d5e-b567-ddb0c654f61b None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:40.137807 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9882c7-6896-4d5e-b567-ddb0c654f61b None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:40.138218 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9882c7-6896-4d5e-b567-ddb0c654f61b None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:40.138901 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9882c7-6896-4d5e-b567-ddb0c654f61b None admin] RBAC: Adding query filter params (name=reader) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:40.139212 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9882c7-6896-4d5e-b567-ddb0c654f61b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:40.140603 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9882c7-6896-4d5e-b567-ddb0c654f61b None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:40.149887 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 99/195] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 00:38:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:40.149887 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9882c7-6896-4d5e-b567-ddb0c654f61b None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:40.249973 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:40.266553 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9882c7-6896-4d5e-b567-ddb0c654f61b None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:40.303093 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0aa840-a14d-4b44-b648-dd45af529add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:40.303738 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0aa840-a14d-4b44-b648-dd45af529add None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:40.304019 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0aa840-a14d-4b44-b648-dd45af529add None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:40.304320 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0aa840-a14d-4b44-b648-dd45af529add None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:40.305014 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0aa840-a14d-4b44-b648-dd45af529add None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:40.305322 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0aa840-a14d-4b44-b648-dd45af529add None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:40.306775 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0aa840-a14d-4b44-b648-dd45af529add None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:40.317494 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 100/196] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:38:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:40.319041 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0aa840-a14d-4b44-b648-dd45af529add None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:40.385406 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 97/197] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 26 00:38:39 2022] POST /identity/v3/users => generated 297 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:40.385406 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6db55f-e0d3-4e61-b58f-7a758700edcc None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:40.443446 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0aa840-a14d-4b44-b648-dd45af529add None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:40.454396 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:40.489272 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee965d18-2705-4c9d-8c41-5272cdddd104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:40.489955 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee965d18-2705-4c9d-8c41-5272cdddd104 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:40.490239 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee965d18-2705-4c9d-8c41-5272cdddd104 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:40.490509 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee965d18-2705-4c9d-8c41-5272cdddd104 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:40.513993 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:40.536517 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6db55f-e0d3-4e61-b58f-7a758700edcc None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:40.582010 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3531458-eba0-47ce-972c-61048367e644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:40.582427 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3531458-eba0-47ce-972c-61048367e644 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:40.582691 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3531458-eba0-47ce-972c-61048367e644 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:40.583007 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3531458-eba0-47ce-972c-61048367e644 None admin] PATH_INFO: `/v3/users/05cfee04eb4e4df69861caa0326b4534` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:40.584605 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3531458-eba0-47ce-972c-61048367e644 None admin] RBAC: Authorizing `identity:get_user(user_id=05cfee04eb4e4df69861caa0326b4534)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:40.586381 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3531458-eba0-47ce-972c-61048367e644 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:40.588010 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 98/198] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:38:40 2022] GET /identity/v3/users/05cfee04eb4e4df69861caa0326b4534 => generated 289 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:40.588837 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3531458-eba0-47ce-972c-61048367e644 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:40.592053 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee965d18-2705-4c9d-8c41-5272cdddd104 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:40.593587 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee965d18-2705-4c9d-8c41-5272cdddd104 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:40.725817 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3531458-eba0-47ce-972c-61048367e644 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:40.729311 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 101/199] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:38:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:38:40.730032 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee965d18-2705-4c9d-8c41-5272cdddd104 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:40.742078 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:40.771652 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeaa19b-d274-4257-a40b-bda725f22e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:40.773044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeaa19b-d274-4257-a40b-bda725f22e47 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:40.773434 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeaa19b-d274-4257-a40b-bda725f22e47 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:40.773727 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeaa19b-d274-4257-a40b-bda725f22e47 None admin] PATH_INFO: `/v3/users/d6c54fc2c7484b03b985896b2bcaa1ea` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:40.775044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeaa19b-d274-4257-a40b-bda725f22e47 None admin] RBAC: Authorizing `identity:get_user(user_id=d6c54fc2c7484b03b985896b2bcaa1ea)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:40.776599 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeaa19b-d274-4257-a40b-bda725f22e47 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:40.778362 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 99/200] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:38:40 2022] GET /identity/v3/users/d6c54fc2c7484b03b985896b2bcaa1ea => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:40.779190 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeaa19b-d274-4257-a40b-bda725f22e47 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:40.793844 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:40.874336 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee965d18-2705-4c9d-8c41-5272cdddd104 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:40.905484 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeaa19b-d274-4257-a40b-bda725f22e47 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:40.926432 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672d9e1-869a-4822-902f-51ed958f9b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:40.927188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672d9e1-869a-4822-902f-51ed958f9b67 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:40.927541 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672d9e1-869a-4822-902f-51ed958f9b67 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:40.927883 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672d9e1-869a-4822-902f-51ed958f9b67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:40.950410 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfea08-a260-4d9f-b5e8-97e526421de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:40.951408 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfea08-a260-4d9f-b5e8-97e526421de4 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:40.951894 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfea08-a260-4d9f-b5e8-97e526421de4 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:40.952373 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfea08-a260-4d9f-b5e8-97e526421de4 None admin] PATH_INFO: `/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:40.954118 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bfea08-a260-4d9f-b5e8-97e526421de4 None admin] RBAC: Authorizing `identity:get_project(project_id=0cb207b03a6c4bee8b0f421096a2b4fc)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:40.955841 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bfea08-a260-4d9f-b5e8-97e526421de4 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:40.957940 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 100/201] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:38:40 2022] GET /identity/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:40.959081 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfea08-a260-4d9f-b5e8-97e526421de4 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:41.019763 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672d9e1-869a-4822-902f-51ed958f9b67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:41.021742 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672d9e1-869a-4822-902f-51ed958f9b67 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:41.037798 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:41.080671 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfea08-a260-4d9f-b5e8-97e526421de4 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:41.087162 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:41.133447 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7882a-f93c-4ac4-a161-4205ebd21790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:41.134380 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7882a-f93c-4ac4-a161-4205ebd21790 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:41.134666 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7882a-f93c-4ac4-a161-4205ebd21790 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:41.134942 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7882a-f93c-4ac4-a161-4205ebd21790 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:41.153306 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 102/202] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:38:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:38:41.154461 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672d9e1-869a-4822-902f-51ed958f9b67 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:41.322651 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672d9e1-869a-4822-902f-51ed958f9b67 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:41.328888 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7882a-f93c-4ac4-a161-4205ebd21790 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:41.330462 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7882a-f93c-4ac4-a161-4205ebd21790 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:41.376999 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8926ce-dc2a-4f2e-9112-34dd9aa78507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:41.377705 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8926ce-dc2a-4f2e-9112-34dd9aa78507 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:41.378071 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8926ce-dc2a-4f2e-9112-34dd9aa78507 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:41.378453 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8926ce-dc2a-4f2e-9112-34dd9aa78507 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:41.379481 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8926ce-dc2a-4f2e-9112-34dd9aa78507 None admin] RBAC: Adding query filter params (role.id=f13055bcebf847bf8b46160ded13810b, scope.project.id=0cb207b03a6c4bee8b0f421096a2b4fc, user.id=d6c54fc2c7484b03b985896b2bcaa1ea) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:41.379869 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8926ce-dc2a-4f2e-9112-34dd9aa78507 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:41.382461 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8926ce-dc2a-4f2e-9112-34dd9aa78507 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:41.391602 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 103/203] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 00:38:41 2022] GET /identity/v3/role_assignments?user.id=d6c54fc2c7484b03b985896b2bcaa1ea&scope.project.id=0cb207b03a6c4bee8b0f421096a2b4fc&role.id=f13055bcebf847bf8b46160ded13810b => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:41.392592 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8926ce-dc2a-4f2e-9112-34dd9aa78507 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:41.425902 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:41.438130 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:41.564058 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 101/204] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:38:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:38:41.575594 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7882a-f93c-4ac4-a161-4205ebd21790 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:41.677958 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8926ce-dc2a-4f2e-9112-34dd9aa78507 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:41.705150 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7882a-f93c-4ac4-a161-4205ebd21790 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:41.744481 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343da82b-1e5e-48e0-8141-31d89f9e8426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:41.746113 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343da82b-1e5e-48e0-8141-31d89f9e8426 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:41.746113 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343da82b-1e5e-48e0-8141-31d89f9e8426 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:41.746113 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343da82b-1e5e-48e0-8141-31d89f9e8426 None admin] PATH_INFO: `/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:41.749421 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343da82b-1e5e-48e0-8141-31d89f9e8426 None admin] RBAC: Authorizing `identity:get_project(project_id=0cb207b03a6c4bee8b0f421096a2b4fc)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:41.749421 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343da82b-1e5e-48e0-8141-31d89f9e8426 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:41.750372 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 102/205] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:38:41 2022] GET /identity/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:41.756492 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343da82b-1e5e-48e0-8141-31d89f9e8426 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:41.758233 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab580c-f0da-443c-a859-9a872433d39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:41.759062 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab580c-f0da-443c-a859-9a872433d39c None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:41.759294 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab580c-f0da-443c-a859-9a872433d39c None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:41.759523 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab580c-f0da-443c-a859-9a872433d39c None admin] PATH_INFO: `/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:41.763017 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab580c-f0da-443c-a859-9a872433d39c None admin] RBAC: Authorizing `identity:get_project(project_id=dd1ea6c1f8214651a9e7c21e90adac21)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:41.766034 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab580c-f0da-443c-a859-9a872433d39c None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:41.776311 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 104/206] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:38:41 2022] GET /identity/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21 => generated 298 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:41.787314 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab580c-f0da-443c-a859-9a872433d39c None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:41.790731 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:41.888158 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343da82b-1e5e-48e0-8141-31d89f9e8426 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:41.968537 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:41.971449 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b3d04-da3e-48ae-a428-593a89c137fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:41.972078 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b3d04-da3e-48ae-a428-593a89c137fe None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:41.972354 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b3d04-da3e-48ae-a428-593a89c137fe None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:41.972616 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b3d04-da3e-48ae-a428-593a89c137fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:41.973507 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b3d04-da3e-48ae-a428-593a89c137fe None admin] RBAC: Adding query filter params (role.id=f0a369eda5014bb78b2d752c9abef48f, scope.project.id=0cb207b03a6c4bee8b0f421096a2b4fc, user.id=d6c54fc2c7484b03b985896b2bcaa1ea) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:41.973818 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b3d04-da3e-48ae-a428-593a89c137fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:41.975293 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b3d04-da3e-48ae-a428-593a89c137fe None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:41.990801 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 103/207] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 00:38:41 2022] GET /identity/v3/role_assignments?user.id=d6c54fc2c7484b03b985896b2bcaa1ea&scope.project.id=0cb207b03a6c4bee8b0f421096a2b4fc&role.id=f0a369eda5014bb78b2d752c9abef48f => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:38:42.010485 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab580c-f0da-443c-a859-9a872433d39c None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:42.079719 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d420e-8a91-4283-acdd-cd1443e43c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:42.080876 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d420e-8a91-4283-acdd-cd1443e43c55 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:42.081560 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d420e-8a91-4283-acdd-cd1443e43c55 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:42.082047 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d420e-8a91-4283-acdd-cd1443e43c55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:42.083382 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d420e-8a91-4283-acdd-cd1443e43c55 None admin] RBAC: Adding query filter params (role.id=1b52a0b7aac8436d9924035295f57093, scope.project.id=dd1ea6c1f8214651a9e7c21e90adac21, user.id=05cfee04eb4e4df69861caa0326b4534) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:42.083909 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d420e-8a91-4283-acdd-cd1443e43c55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:42.086566 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d420e-8a91-4283-acdd-cd1443e43c55 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:42.099212 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 105/208] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 00:38:41 2022] GET /identity/v3/role_assignments?user.id=05cfee04eb4e4df69861caa0326b4534&scope.project.id=dd1ea6c1f8214651a9e7c21e90adac21&role.id=1b52a0b7aac8436d9924035295f57093 => generated 608 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:43.605283 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d89e5-f6a1-4ae0-97c2-390bf5b4bdbd None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:43.606347 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d89e5-f6a1-4ae0-97c2-390bf5b4bdbd None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:43.606347 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d89e5-f6a1-4ae0-97c2-390bf5b4bdbd None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:43.608600 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 104/209] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:43.617059 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a33cc-c28f-41aa-8be5-bb825e80921a None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:43.618453 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a33cc-c28f-41aa-8be5-bb825e80921a None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:43.619200 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a33cc-c28f-41aa-8be5-bb825e80921a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:43.645925 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7874f83-c944-42b4-b707-d953bdf371ca None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:43.646369 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7874f83-c944-42b4-b707-d953bdf371ca None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:43.646812 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7874f83-c944-42b4-b707-d953bdf371ca None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:43.648774 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 105/210] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:43.651301 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-824a33cc-c28f-41aa-8be5-bb825e80921a None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:43.654319 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-824a33cc-c28f-41aa-8be5-bb825e80921a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:43.657960 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cadd1-6230-4619-a7ed-3209bc7a18ca None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:43.658425 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cadd1-6230-4619-a7ed-3209bc7a18ca None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:43.658886 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cadd1-6230-4619-a7ed-3209bc7a18ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:43.686766 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-b68cadd1-6230-4619-a7ed-3209bc7a18ca None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:43.688662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-b68cadd1-6230-4619-a7ed-3209bc7a18ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:43.785423 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 106/211] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:43.798157 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 106/212] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:43.977038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e2422-ca6e-4173-9a43-e0ad2be047ba None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:43.977324 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e2422-ca6e-4173-9a43-e0ad2be047ba None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:43.977648 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e2422-ca6e-4173-9a43-e0ad2be047ba None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:43.979195 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 107/213] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:43.984935 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771da7ed-321d-4198-aedf-041e81d1da73 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:43.985358 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771da7ed-321d-4198-aedf-041e81d1da73 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:43.985764 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771da7ed-321d-4198-aedf-041e81d1da73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:44.005240 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-771da7ed-321d-4198-aedf-041e81d1da73 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:44.006484 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-771da7ed-321d-4198-aedf-041e81d1da73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:44.010536 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:44.081110 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 107/214] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:44.137253 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e2422-ca6e-4173-9a43-e0ad2be047ba None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:44.171780 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771da7ed-321d-4198-aedf-041e81d1da73 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:44.229046 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:44.259340 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e2422-ca6e-4173-9a43-e0ad2be047ba None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:44.310061 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bcf7c-a81a-4b9e-8906-f4cee8492761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:44.311228 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bcf7c-a81a-4b9e-8906-f4cee8492761 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:44.311794 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bcf7c-a81a-4b9e-8906-f4cee8492761 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:44.312347 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bcf7c-a81a-4b9e-8906-f4cee8492761 None admin] PATH_INFO: `/v3/domains/default` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:44.314368 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bcf7c-a81a-4b9e-8906-f4cee8492761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:44.317069 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bcf7c-a81a-4b9e-8906-f4cee8492761 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:44.325446 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 108/215] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:38:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:44.325666 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771da7ed-321d-4198-aedf-041e81d1da73 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:44.328515 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bcf7c-a81a-4b9e-8906-f4cee8492761 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:44.375215 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bcfc9-5ea7-45c3-b6a4-40c8af30ba43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:44.376310 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bcfc9-5ea7-45c3-b6a4-40c8af30ba43 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:44.376678 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bcfc9-5ea7-45c3-b6a4-40c8af30ba43 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:44.377075 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bcfc9-5ea7-45c3-b6a4-40c8af30ba43 None admin] PATH_INFO: `/v3/roles/member` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:44.387960 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:44.393020 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131bcfc9-5ea7-45c3-b6a4-40c8af30ba43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:38:44.399815 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-131bcfc9-5ea7-45c3-b6a4-40c8af30ba43 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:38:44.399815 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:44.399815 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:44.399815 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:44.399815 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:44.399815 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:44.399815 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:44.399815 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:44.399815 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:44.399815 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:44.399815 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:44.399815 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:44.399815 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:38:44.399815 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:38:44.399815 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:38:44.399815 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:38:44.400722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:38:44.400722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:38:44.400722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:38:44.400722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:38:44.400722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:44.400722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:44.400722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:44.400722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:44.400722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:44.400722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:44.400722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:44.400722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:44.400722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:44.400722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:44.400722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:44.400722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:44.402102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:44.402102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:44.402102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:44.402102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:44.402102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:38:44.402102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:38:44.402102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:38:44.402102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:38:44.402102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:38:44.402102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:38:44.402102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:38:44.402102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:38:44.402102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 108/216] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:38:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:38:44.407308 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bcfc9-5ea7-45c3-b6a4-40c8af30ba43 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:44.471131 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bcf7c-a81a-4b9e-8906-f4cee8492761 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:44.510631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86979cb3-4767-4aba-ab84-e6fe97b01770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:44.511494 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86979cb3-4767-4aba-ab84-e6fe97b01770 None admin] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:44.512065 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86979cb3-4767-4aba-ab84-e6fe97b01770 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:44.512300 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86979cb3-4767-4aba-ab84-e6fe97b01770 None admin] PATH_INFO: `/v3/users` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:44.512963 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86979cb3-4767-4aba-ab84-e6fe97b01770 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:44.514475 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86979cb3-4767-4aba-ab84-e6fe97b01770 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:44.523766 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bcfc9-5ea7-45c3-b6a4-40c8af30ba43 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:44.562464 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26771fbe-56b6-4d2d-94cb-65e6c3e7942c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:44.563084 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26771fbe-56b6-4d2d-94cb-65e6c3e7942c None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:44.563365 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26771fbe-56b6-4d2d-94cb-65e6c3e7942c None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:44.563643 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26771fbe-56b6-4d2d-94cb-65e6c3e7942c None admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:44.564321 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26771fbe-56b6-4d2d-94cb-65e6c3e7942c None admin] RBAC: Adding query filter params (name=member) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:44.564632 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26771fbe-56b6-4d2d-94cb-65e6c3e7942c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:44.566140 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26771fbe-56b6-4d2d-94cb-65e6c3e7942c None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:44.575965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 109/217] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 00:38:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:38:44.576897 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26771fbe-56b6-4d2d-94cb-65e6c3e7942c None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:44.640353 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:44.641756 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:44.647288 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 109/218] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 26 00:38:44 2022] POST /identity/v3/users => generated 297 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:38:44.654423 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86979cb3-4767-4aba-ab84-e6fe97b01770 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:44.694395 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26771fbe-56b6-4d2d-94cb-65e6c3e7942c None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:44.738766 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd81f2-b888-401b-8f1c-8c37cec5939d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:44.739420 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd81f2-b888-401b-8f1c-8c37cec5939d None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:44.739708 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd81f2-b888-401b-8f1c-8c37cec5939d None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:44.739984 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd81f2-b888-401b-8f1c-8c37cec5939d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:44.753337 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd81f2-b888-401b-8f1c-8c37cec5939d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:38:44.758863 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-fcdd81f2-b888-401b-8f1c-8c37cec5939d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:38:44.758863 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:44.758863 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:44.758863 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:44.758863 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:44.758863 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:44.758863 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:44.758863 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:44.758863 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:44.758863 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:44.758863 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:44.758863 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:44.758863 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:38:44.758863 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:38:44.758863 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:38:44.758863 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:38:44.759883 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:38:44.759883 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:38:44.759883 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:38:44.759883 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:38:44.759883 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:44.759883 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:44.759883 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:44.759883 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:44.759883 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:44.759883 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:44.759883 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:44.759883 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:44.759883 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:44.759883 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:44.759883 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:44.759883 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:44.760696 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:44.760696 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:44.760696 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:44.760696 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:44.760696 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:38:44.760696 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:38:44.760696 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:38:44.760696 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:38:44.760696 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:38:44.760696 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:38:44.760696 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:38:44.760696 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:38:44.760696 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 110/219] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 00:38:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:38:44.763349 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7a15e-4a28-467d-844f-87701efb696e None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:44.763349 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7a15e-4a28-467d-844f-87701efb696e None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:44.763349 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7a15e-4a28-467d-844f-87701efb696e None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:44.766781 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 111/220] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:44.768257 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7a15e-4a28-467d-844f-87701efb696e None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:44.789508 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86979cb3-4767-4aba-ab84-e6fe97b01770 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:44.839664 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0b976-5a77-4b69-a5c6-fea303feaca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:44.840383 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0b976-5a77-4b69-a5c6-fea303feaca8 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:44.840707 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0b976-5a77-4b69-a5c6-fea303feaca8 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:44.840920 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0b976-5a77-4b69-a5c6-fea303feaca8 None admin] PATH_INFO: `/v3/users/a1df79c637df4efba54b47bb6811fce2` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:44.866295 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0b976-5a77-4b69-a5c6-fea303feaca8 None admin] RBAC: Authorizing `identity:get_user(user_id=a1df79c637df4efba54b47bb6811fce2)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:44.868227 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0b976-5a77-4b69-a5c6-fea303feaca8 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:44.870716 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 110/221] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:38:44 2022] GET /identity/v3/users/a1df79c637df4efba54b47bb6811fce2 => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:44.871812 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad59523-9d0a-43c3-846c-ab980d0a0e8b None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:44.872209 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad59523-9d0a-43c3-846c-ab980d0a0e8b None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:44.872361 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad59523-9d0a-43c3-846c-ab980d0a0e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:44.894022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-8ad59523-9d0a-43c3-846c-ab980d0a0e8b None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:44.896156 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-8ad59523-9d0a-43c3-846c-ab980d0a0e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:44.922656 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7a15e-4a28-467d-844f-87701efb696e None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:44.963305 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:44.973534 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:44.985044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afd13c-b6d0-4a8d-9758-a5d5854096e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:44.985982 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afd13c-b6d0-4a8d-9758-a5d5854096e2 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:44.986423 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afd13c-b6d0-4a8d-9758-a5d5854096e2 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:44.986704 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afd13c-b6d0-4a8d-9758-a5d5854096e2 None admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:44.987475 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afd13c-b6d0-4a8d-9758-a5d5854096e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:44.989154 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afd13c-b6d0-4a8d-9758-a5d5854096e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:44.990693 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afd13c-b6d0-4a8d-9758-a5d5854096e2 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:45.002740 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 111/222] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:45.003904 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad59523-9d0a-43c3-846c-ab980d0a0e8b None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:45.004059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 112/223] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:38:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:45.040107 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afd13c-b6d0-4a8d-9758-a5d5854096e2 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:45.136291 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afd13c-b6d0-4a8d-9758-a5d5854096e2 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:45.168828 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad59523-9d0a-43c3-846c-ab980d0a0e8b None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:45.176121 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ed083-ea10-418f-95cc-6d728ff1cf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:45.176817 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ed083-ea10-418f-95cc-6d728ff1cf85 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:45.177098 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ed083-ea10-418f-95cc-6d728ff1cf85 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:45.177395 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ed083-ea10-418f-95cc-6d728ff1cf85 None admin] PATH_INFO: `/v3/users/d6c54fc2c7484b03b985896b2bcaa1ea` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:45.178582 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ed083-ea10-418f-95cc-6d728ff1cf85 None admin] RBAC: Authorizing `identity:get_user(user_id=d6c54fc2c7484b03b985896b2bcaa1ea)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:45.180124 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ed083-ea10-418f-95cc-6d728ff1cf85 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:45.182127 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 113/224] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:38:45 2022] GET /identity/v3/users/d6c54fc2c7484b03b985896b2bcaa1ea => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:38:45.189298 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ed083-ea10-418f-95cc-6d728ff1cf85 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:45.235922 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03fcc2-3992-44f5-b79e-06d85dc92edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:45.236570 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03fcc2-3992-44f5-b79e-06d85dc92edc None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:45.236857 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03fcc2-3992-44f5-b79e-06d85dc92edc None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:45.237138 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03fcc2-3992-44f5-b79e-06d85dc92edc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:45.260330 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:45.317996 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ed083-ea10-418f-95cc-6d728ff1cf85 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:45.334582 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:45.351218 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03fcc2-3992-44f5-b79e-06d85dc92edc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:45.352711 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03fcc2-3992-44f5-b79e-06d85dc92edc None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:45.369072 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb71667-6c15-477b-8a87-39743629efbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:45.370149 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb71667-6c15-477b-8a87-39743629efbc None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:45.370937 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb71667-6c15-477b-8a87-39743629efbc None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:45.371463 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb71667-6c15-477b-8a87-39743629efbc None admin] PATH_INFO: `/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:45.374623 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb71667-6c15-477b-8a87-39743629efbc None admin] RBAC: Authorizing `identity:get_project(project_id=0cb207b03a6c4bee8b0f421096a2b4fc)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:45.376288 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb71667-6c15-477b-8a87-39743629efbc None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:45.380714 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 114/225] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:38:45 2022] GET /identity/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:45.385413 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb71667-6c15-477b-8a87-39743629efbc None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:45.533440 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 112/226] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:38:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:38:45.533440 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03fcc2-3992-44f5-b79e-06d85dc92edc None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:45.564153 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb71667-6c15-477b-8a87-39743629efbc None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:45.607343 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:45.619154 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea494c-de4a-4512-9dd7-b82c26e034f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:45.620242 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea494c-de4a-4512-9dd7-b82c26e034f4 None admin] REQUEST_METHOD: `PUT` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:45.621286 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea494c-de4a-4512-9dd7-b82c26e034f4 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:45.621781 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea494c-de4a-4512-9dd7-b82c26e034f4 None admin] PATH_INFO: `/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc/users/d6c54fc2c7484b03b985896b2bcaa1ea/roles/f13055bcebf847bf8b46160ded13810b` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:45.624032 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea494c-de4a-4512-9dd7-b82c26e034f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=0cb207b03a6c4bee8b0f421096a2b4fc, user_id=d6c54fc2c7484b03b985896b2bcaa1ea, role_id=f13055bcebf847bf8b46160ded13810b)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:45.625843 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea494c-de4a-4512-9dd7-b82c26e034f4 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:45.636788 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:45.652727 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03fcc2-3992-44f5-b79e-06d85dc92edc None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:45.689867 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a79c51-0e12-43a9-9757-dfc31fc9e644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:45.690430 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a79c51-0e12-43a9-9757-dfc31fc9e644 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:45.690768 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a79c51-0e12-43a9-9757-dfc31fc9e644 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:45.690993 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a79c51-0e12-43a9-9757-dfc31fc9e644 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:45.705050 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a79c51-0e12-43a9-9757-dfc31fc9e644 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:38:45.705493 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 115/227] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 00:38:45 2022] PUT /identity/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc/users/d6c54fc2c7484b03b985896b2bcaa1ea/roles/f13055bcebf847bf8b46160ded13810b => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:38:45.707140 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea494c-de4a-4512-9dd7-b82c26e034f4 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:45.712038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-f9a79c51-0e12-43a9-9757-dfc31fc9e644 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:38:45.712038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:45.712038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:45.712038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:45.712038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:45.712038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:45.712038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:45.712038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:45.712038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:45.712038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:45.712038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:45.712038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:45.712038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:38:45.712038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:38:45.712038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:38:45.712038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:38:45.713410 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:38:45.713410 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:38:45.713410 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:38:45.713410 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:38:45.713410 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:45.713410 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:45.713410 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:45.713410 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:45.713410 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:45.713410 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:45.713410 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:45.713410 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:45.713410 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:45.713410 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:45.713410 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:45.713410 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:45.714444 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:45.714444 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:45.714444 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:45.714444 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:45.714444 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:38:45.714444 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:38:45.714444 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:38:45.714444 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:38:45.714444 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:38:45.714444 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:38:45.714444 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:38:45.714444 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:38:45.714444 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 113/228] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 00:38:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:38:45.728822 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a79c51-0e12-43a9-9757-dfc31fc9e644 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:45.852936 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea494c-de4a-4512-9dd7-b82c26e034f4 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:45.898644 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfa759-741d-4352-812e-0421f81577bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:45.900327 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfa759-741d-4352-812e-0421f81577bf None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:45.900826 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfa759-741d-4352-812e-0421f81577bf None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:45.901903 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfa759-741d-4352-812e-0421f81577bf None admin] PATH_INFO: `/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:45.903678 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cfa759-741d-4352-812e-0421f81577bf None admin] RBAC: Authorizing `identity:get_project(project_id=0cb207b03a6c4bee8b0f421096a2b4fc)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:45.905392 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cfa759-741d-4352-812e-0421f81577bf None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:45.907305 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 116/229] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:38:45 2022] GET /identity/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:45.914830 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfa759-741d-4352-812e-0421f81577bf None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:45.949625 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a79c51-0e12-43a9-9757-dfc31fc9e644 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:45.992837 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494398e-324c-4767-a154-e8572cd6c6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:45.993486 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494398e-324c-4767-a154-e8572cd6c6a7 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:45.993768 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494398e-324c-4767-a154-e8572cd6c6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:45.994043 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494398e-324c-4767-a154-e8572cd6c6a7 None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:45.994722 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7494398e-324c-4767-a154-e8572cd6c6a7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:45.995032 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7494398e-324c-4767-a154-e8572cd6c6a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:45.996753 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7494398e-324c-4767-a154-e8572cd6c6a7 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:46.006642 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 114/230] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:38:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:46.009747 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:46.014860 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494398e-324c-4767-a154-e8572cd6c6a7 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:46.030720 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:46.046232 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfa759-741d-4352-812e-0421f81577bf None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:46.094810 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1f556-b039-410c-9bf1-ec6496de05f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:46.095745 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1f556-b039-410c-9bf1-ec6496de05f1 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:46.096241 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1f556-b039-410c-9bf1-ec6496de05f1 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:46.096942 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1f556-b039-410c-9bf1-ec6496de05f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:46.098903 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1f556-b039-410c-9bf1-ec6496de05f1 None admin] RBAC: Adding query filter params (role.id=64e752fa5df040c1a0b12914b5dacd49, scope.project.id=0cb207b03a6c4bee8b0f421096a2b4fc, user.id=a1df79c637df4efba54b47bb6811fce2) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:46.099393 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1f556-b039-410c-9bf1-ec6496de05f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:46.101218 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1f556-b039-410c-9bf1-ec6496de05f1 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:46.116196 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 117/231] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 00:38:45 2022] GET /identity/v3/role_assignments?user.id=a1df79c637df4efba54b47bb6811fce2&scope.project.id=0cb207b03a6c4bee8b0f421096a2b4fc&role.id=64e752fa5df040c1a0b12914b5dacd49 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:46.164615 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494398e-324c-4767-a154-e8572cd6c6a7 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:46.206954 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c918f1-0367-4a12-8057-133a4e3476a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:46.207626 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c918f1-0367-4a12-8057-133a4e3476a4 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:46.207910 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c918f1-0367-4a12-8057-133a4e3476a4 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:46.208248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c918f1-0367-4a12-8057-133a4e3476a4 None admin] PATH_INFO: `/v3/users/d6c54fc2c7484b03b985896b2bcaa1ea` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:46.209735 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c918f1-0367-4a12-8057-133a4e3476a4 None admin] RBAC: Authorizing `identity:get_user(user_id=d6c54fc2c7484b03b985896b2bcaa1ea)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:46.211268 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c918f1-0367-4a12-8057-133a4e3476a4 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:46.213433 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 115/232] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:38:46 2022] GET /identity/v3/users/d6c54fc2c7484b03b985896b2bcaa1ea => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:46.219599 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1f556-b039-410c-9bf1-ec6496de05f1 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:46.368304 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1f556-b039-410c-9bf1-ec6496de05f1 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:46.393789 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:46.408406 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c587aff-5f72-4f44-b298-51b515df4c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:46.409228 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c587aff-5f72-4f44-b298-51b515df4c36 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:46.409630 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c587aff-5f72-4f44-b298-51b515df4c36 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:46.409976 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c587aff-5f72-4f44-b298-51b515df4c36 None admin] PATH_INFO: `/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:46.411214 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c587aff-5f72-4f44-b298-51b515df4c36 None admin] RBAC: Authorizing `identity:get_project(project_id=0cb207b03a6c4bee8b0f421096a2b4fc)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:46.412758 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c587aff-5f72-4f44-b298-51b515df4c36 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:46.414983 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 118/233] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:38:46 2022] GET /identity/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:46.420708 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c918f1-0367-4a12-8057-133a4e3476a4 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:46.548358 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:46.578701 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c918f1-0367-4a12-8057-133a4e3476a4 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:46.634732 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1feca55-6b5b-44b1-a8e7-6c9e23b7e278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:46.645468 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1feca55-6b5b-44b1-a8e7-6c9e23b7e278 None admin] REQUEST_METHOD: `PUT` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:46.645468 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1feca55-6b5b-44b1-a8e7-6c9e23b7e278 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:46.645468 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1feca55-6b5b-44b1-a8e7-6c9e23b7e278 None admin] PATH_INFO: `/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc/users/d6c54fc2c7484b03b985896b2bcaa1ea/roles/f0a369eda5014bb78b2d752c9abef48f` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:46.645468 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1feca55-6b5b-44b1-a8e7-6c9e23b7e278 None admin] RBAC: Authorizing `identity:create_grant(project_id=0cb207b03a6c4bee8b0f421096a2b4fc, user_id=d6c54fc2c7484b03b985896b2bcaa1ea, role_id=f0a369eda5014bb78b2d752c9abef48f)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:46.645468 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1feca55-6b5b-44b1-a8e7-6c9e23b7e278 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:47.005796 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 116/234] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 00:38:46 2022] PUT /identity/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc/users/d6c54fc2c7484b03b985896b2bcaa1ea/roles/f0a369eda5014bb78b2d752c9abef48f => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:47.614732 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6eb89d-b78e-4319-8b9c-ae2225a32460 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:47.615311 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6eb89d-b78e-4319-8b9c-ae2225a32460 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:47.615311 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6eb89d-b78e-4319-8b9c-ae2225a32460 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:47.616976 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 119/235] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:47.636112 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d88fd-94ec-46c8-b685-e93dfd77a4b8 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:47.636570 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d88fd-94ec-46c8-b685-e93dfd77a4b8 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:47.637060 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d88fd-94ec-46c8-b685-e93dfd77a4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:47.669644 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f1265-82c2-49be-b068-d167e401f494 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:47.669998 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f1265-82c2-49be-b068-d167e401f494 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:47.670335 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f1265-82c2-49be-b068-d167e401f494 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:47.672024 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 120/236] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:47.674285 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-3a5d88fd-94ec-46c8-b685-e93dfd77a4b8 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:47.676388 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-3a5d88fd-94ec-46c8-b685-e93dfd77a4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:47.677971 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8eab6b-a501-47ec-a20c-fc09e16d37fb None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:47.678264 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8eab6b-a501-47ec-a20c-fc09e16d37fb None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:47.678553 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8eab6b-a501-47ec-a20c-fc09e16d37fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:47.699385 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-3a8eab6b-a501-47ec-a20c-fc09e16d37fb None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:47.700740 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-3a8eab6b-a501-47ec-a20c-fc09e16d37fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:47.826019 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 117/237] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:47.852919 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 121/238] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:48.302327 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d88fd-94ec-46c8-b685-e93dfd77a4b8 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:48.325262 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8eab6b-a501-47ec-a20c-fc09e16d37fb None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:48.431760 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:48.496122 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d88fd-94ec-46c8-b685-e93dfd77a4b8 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:48.512061 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8eab6b-a501-47ec-a20c-fc09e16d37fb None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:48.523761 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:48.534957 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bc8bc-d24f-4408-94f1-ef0441478a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:48.536002 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bc8bc-d24f-4408-94f1-ef0441478a5b None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:48.536002 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bc8bc-d24f-4408-94f1-ef0441478a5b None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:48.536264 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bc8bc-d24f-4408-94f1-ef0441478a5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:48.537456 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3bc8bc-d24f-4408-94f1-ef0441478a5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:48.539039 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3bc8bc-d24f-4408-94f1-ef0441478a5b None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:48.540789 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 118/239] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:38:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:48.546674 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfa5be-14a8-4bc9-a1c4-feeea3d2476f None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:48.546674 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfa5be-14a8-4bc9-a1c4-feeea3d2476f None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:48.546674 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfa5be-14a8-4bc9-a1c4-feeea3d2476f None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:48.546674 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 119/240] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:48.550575 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfa5be-14a8-4bc9-a1c4-feeea3d2476f None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:48.559402 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78301f1-534a-4f99-bf43-afb78f02dcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:48.559969 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78301f1-534a-4f99-bf43-afb78f02dcac None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:48.560249 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78301f1-534a-4f99-bf43-afb78f02dcac None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:48.560520 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78301f1-534a-4f99-bf43-afb78f02dcac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:48.574275 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78301f1-534a-4f99-bf43-afb78f02dcac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:38:48.579555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-c78301f1-534a-4f99-bf43-afb78f02dcac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:38:48.579555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:48.579555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:48.579555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:48.579555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:48.579555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:48.579555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:48.579555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:48.579555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:48.579555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:48.579555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:48.579555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:48.579555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:38:48.579555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:38:48.579555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:38:48.579555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:38:48.580466 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:38:48.580466 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:38:48.580466 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:38:48.580466 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:38:48.580466 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:48.580466 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:48.580466 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:48.580466 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:48.580466 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:48.580466 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:48.580466 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:48.580466 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:48.580466 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:48.580466 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:48.580466 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:48.580466 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:48.581271 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:48.581271 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:48.581271 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:48.581271 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:48.581271 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:38:48.581271 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:38:48.581271 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:38:48.581271 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:38:48.581271 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:38:48.581271 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:38:48.581271 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:38:48.581271 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:38:48.583622 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 122/241] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:38:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:38:48.590128 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c43bc-348d-4067-8bcf-c6541fad7883 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:48.590636 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c43bc-348d-4067-8bcf-c6541fad7883 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:48.591181 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c43bc-348d-4067-8bcf-c6541fad7883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:48.610491 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-e81c43bc-348d-4067-8bcf-c6541fad7883 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:48.611960 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-e81c43bc-348d-4067-8bcf-c6541fad7883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:48.683708 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfa5be-14a8-4bc9-a1c4-feeea3d2476f None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:48.708749 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 123/242] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:48.718008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c43bc-348d-4067-8bcf-c6541fad7883 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:48.755830 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0df63-5bbc-4c5c-83ba-26c8f463f2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:48.756790 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0df63-5bbc-4c5c-83ba-26c8f463f2c8 None admin] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:48.757265 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0df63-5bbc-4c5c-83ba-26c8f463f2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:48.757767 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0df63-5bbc-4c5c-83ba-26c8f463f2c8 None admin] PATH_INFO: `/v3/users` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:48.758675 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f0df63-5bbc-4c5c-83ba-26c8f463f2c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:48.760344 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f0df63-5bbc-4c5c-83ba-26c8f463f2c8 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:48.777742 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:48.832476 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:48.835892 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c43bc-348d-4067-8bcf-c6541fad7883 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:48.873187 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242dfa36-21e0-48e8-86dd-80dc73f7fe44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:48.873869 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242dfa36-21e0-48e8-86dd-80dc73f7fe44 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:48.874152 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242dfa36-21e0-48e8-86dd-80dc73f7fe44 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:48.874428 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242dfa36-21e0-48e8-86dd-80dc73f7fe44 None admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:48.875132 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242dfa36-21e0-48e8-86dd-80dc73f7fe44 None admin] RBAC: Adding query filter params (name=reader) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:48.875460 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242dfa36-21e0-48e8-86dd-80dc73f7fe44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:48.876873 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242dfa36-21e0-48e8-86dd-80dc73f7fe44 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:48.885415 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 124/243] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 00:38:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:48.887804 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c1a73-780e-43be-b3ff-e3f515e1e833 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:48.887804 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c1a73-780e-43be-b3ff-e3f515e1e833 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:48.888000 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c1a73-780e-43be-b3ff-e3f515e1e833 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:48.889139 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 125/244] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:48.894071 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c1a73-780e-43be-b3ff-e3f515e1e833 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:48.915887 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 120/245] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 26 00:38:48 2022] POST /identity/v3/users => generated 293 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:48.918138 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd92e20-79b5-4e6f-bdeb-46c57f59dd98 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:48.918434 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd92e20-79b5-4e6f-bdeb-46c57f59dd98 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:48.918698 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd92e20-79b5-4e6f-bdeb-46c57f59dd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:48.954747 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-5fd92e20-79b5-4e6f-bdeb-46c57f59dd98 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:48.956002 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-5fd92e20-79b5-4e6f-bdeb-46c57f59dd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:49.082111 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c1a73-780e-43be-b3ff-e3f515e1e833 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:49.109932 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 121/246] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:49.111631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd92e20-79b5-4e6f-bdeb-46c57f59dd98 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:49.123534 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eff29a-04aa-4ccb-9056-784930f93594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:49.124182 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eff29a-04aa-4ccb-9056-784930f93594 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:49.124471 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eff29a-04aa-4ccb-9056-784930f93594 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:49.124866 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eff29a-04aa-4ccb-9056-784930f93594 None admin] PATH_INFO: `/v3/users/8bb174dbd4f74861a7ef5430726d0ffa` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:49.144063 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eff29a-04aa-4ccb-9056-784930f93594 None admin] RBAC: Authorizing `identity:get_user(user_id=8bb174dbd4f74861a7ef5430726d0ffa)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:49.145585 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eff29a-04aa-4ccb-9056-784930f93594 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:49.152037 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 126/247] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:38:48 2022] GET /identity/v3/users/8bb174dbd4f74861a7ef5430726d0ffa => generated 297 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:49.154669 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eff29a-04aa-4ccb-9056-784930f93594 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:49.182877 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:49.245436 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd92e20-79b5-4e6f-bdeb-46c57f59dd98 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:49.272961 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:49.283625 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eff29a-04aa-4ccb-9056-784930f93594 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:49.297124 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2016e5-0c66-4a7f-9479-b249da9986e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:49.297983 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2016e5-0c66-4a7f-9479-b249da9986e2 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:49.298445 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2016e5-0c66-4a7f-9479-b249da9986e2 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:49.298835 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2016e5-0c66-4a7f-9479-b249da9986e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:49.314722 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2016e5-0c66-4a7f-9479-b249da9986e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:38:49.321802 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-9e2016e5-0c66-4a7f-9479-b249da9986e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:38:49.321802 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:49.321802 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:49.321802 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:49.321802 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:49.321802 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:49.321802 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:49.321802 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:49.321802 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:49.321802 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:49.321802 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:49.321802 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:49.321802 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:38:49.321802 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:38:49.321802 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:38:49.321802 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:38:49.322906 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:38:49.322906 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:38:49.322906 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:38:49.322906 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:38:49.322906 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:49.322906 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:49.322906 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:49.322906 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:49.322906 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:49.322906 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:49.322906 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:49.322906 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:49.322906 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:49.322906 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:49.322906 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:49.322906 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:49.324647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:49.324647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:49.324647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:49.324647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:49.324647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:38:49.324647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:38:49.324647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:38:49.324647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:38:49.324647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:38:49.324647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:38:49.324647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:38:49.324647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:38:49.326042 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 122/248] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 00:38:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:38:49.332031 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2016e5-0c66-4a7f-9479-b249da9986e2 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:49.337212 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfdb1b1-3c0a-4787-a9d6-85f45ccd0e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:49.338144 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdb1b1-3c0a-4787-a9d6-85f45ccd0e2b None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:49.338640 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdb1b1-3c0a-4787-a9d6-85f45ccd0e2b None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:49.339740 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdb1b1-3c0a-4787-a9d6-85f45ccd0e2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:49.422512 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfdb1b1-3c0a-4787-a9d6-85f45ccd0e2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:49.425862 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfdb1b1-3c0a-4787-a9d6-85f45ccd0e2b None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:49.443409 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2016e5-0c66-4a7f-9479-b249da9986e2 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:49.451171 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:49.483230 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c240d-f01a-47d0-aafc-91d8ea4bb849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:49.483857 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c240d-f01a-47d0-aafc-91d8ea4bb849 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:49.484145 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c240d-f01a-47d0-aafc-91d8ea4bb849 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:49.484426 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c240d-f01a-47d0-aafc-91d8ea4bb849 None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:49.485117 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c240d-f01a-47d0-aafc-91d8ea4bb849 None admin] RBAC: Adding query filter params (name=admin) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:49.485454 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c240d-f01a-47d0-aafc-91d8ea4bb849 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:49.486883 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c240d-f01a-47d0-aafc-91d8ea4bb849 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:49.501012 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 123/249] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:38:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:49.502487 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c240d-f01a-47d0-aafc-91d8ea4bb849 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:49.549973 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 127/250] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:38:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:38:49.551566 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfdb1b1-3c0a-4787-a9d6-85f45ccd0e2b None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:49.558921 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:49.631128 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c240d-f01a-47d0-aafc-91d8ea4bb849 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:49.688233 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415939b6-155b-4632-8c5c-09b2b97b5e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:49.689069 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415939b6-155b-4632-8c5c-09b2b97b5e1a None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:49.689353 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415939b6-155b-4632-8c5c-09b2b97b5e1a None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:49.689734 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415939b6-155b-4632-8c5c-09b2b97b5e1a None admin] PATH_INFO: `/v3/users/d6c54fc2c7484b03b985896b2bcaa1ea` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:49.690910 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415939b6-155b-4632-8c5c-09b2b97b5e1a None admin] RBAC: Authorizing `identity:get_user(user_id=d6c54fc2c7484b03b985896b2bcaa1ea)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:49.693002 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415939b6-155b-4632-8c5c-09b2b97b5e1a None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:49.695336 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 124/251] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:38:49 2022] GET /identity/v3/users/d6c54fc2c7484b03b985896b2bcaa1ea => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:49.696617 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415939b6-155b-4632-8c5c-09b2b97b5e1a None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:49.700768 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfdb1b1-3c0a-4787-a9d6-85f45ccd0e2b None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:49.732919 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:49.751734 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30acf1-1b7d-46b7-9650-bbfdcdd87a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:49.752391 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30acf1-1b7d-46b7-9650-bbfdcdd87a20 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:49.752675 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30acf1-1b7d-46b7-9650-bbfdcdd87a20 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:49.752954 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30acf1-1b7d-46b7-9650-bbfdcdd87a20 None admin] PATH_INFO: `/v3/roles/member` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:49.764962 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e30acf1-1b7d-46b7-9650-bbfdcdd87a20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:38:49.770120 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-2e30acf1-1b7d-46b7-9650-bbfdcdd87a20 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:38:49.770120 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:49.770120 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:49.770120 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:49.770120 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:49.770120 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:49.770120 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:49.770120 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:49.770120 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:49.770120 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:49.770120 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:49.770120 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:49.770120 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:38:49.770120 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:38:49.770120 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:38:49.770120 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:38:49.771059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:38:49.771059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:38:49.771059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:38:49.771059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:38:49.771059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:49.771059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:49.771059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:49.771059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:49.771059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:49.771059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:49.771059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:49.771059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:49.771059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:49.771059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:49.771059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:49.771059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:49.771826 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:49.771826 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:49.771826 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:49.771826 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:49.771826 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:38:49.771826 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:38:49.771826 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:38:49.771826 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:38:49.771826 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:38:49.771826 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:38:49.771826 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:38:49.771826 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:38:49.772952 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 128/252] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:38:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:38:49.773910 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30acf1-1b7d-46b7-9650-bbfdcdd87a20 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:49.857412 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415939b6-155b-4632-8c5c-09b2b97b5e1a None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:49.869404 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:49.892874 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f10b9-b364-425c-a650-10808c3125b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:49.893574 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f10b9-b364-425c-a650-10808c3125b0 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:49.893864 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f10b9-b364-425c-a650-10808c3125b0 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:49.894145 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f10b9-b364-425c-a650-10808c3125b0 None admin] PATH_INFO: `/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:49.895673 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f10b9-b364-425c-a650-10808c3125b0 None admin] RBAC: Authorizing `identity:get_project(project_id=0cb207b03a6c4bee8b0f421096a2b4fc)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:49.898066 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f10b9-b364-425c-a650-10808c3125b0 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:49.905845 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 125/253] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:38:49 2022] GET /identity/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:49.905845 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f10b9-b364-425c-a650-10808c3125b0 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:49.959221 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30acf1-1b7d-46b7-9650-bbfdcdd87a20 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:50.000816 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2c201-e127-4ea1-b1c3-aca65c42a10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:50.002233 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2c201-e127-4ea1-b1c3-aca65c42a10b None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:50.002233 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2c201-e127-4ea1-b1c3-aca65c42a10b None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:50.002233 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2c201-e127-4ea1-b1c3-aca65c42a10b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:50.054058 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f10b9-b364-425c-a650-10808c3125b0 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:50.063185 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:50.083837 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2c201-e127-4ea1-b1c3-aca65c42a10b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:50.087493 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2c201-e127-4ea1-b1c3-aca65c42a10b None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:50.097803 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076d7e8-d7d2-43fe-8116-2107380c0554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:50.098996 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076d7e8-d7d2-43fe-8116-2107380c0554 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:50.099354 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076d7e8-d7d2-43fe-8116-2107380c0554 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:50.099707 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076d7e8-d7d2-43fe-8116-2107380c0554 None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:50.100595 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076d7e8-d7d2-43fe-8116-2107380c0554 None admin] RBAC: Adding query filter params (name=member) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:50.101445 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076d7e8-d7d2-43fe-8116-2107380c0554 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:50.103285 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076d7e8-d7d2-43fe-8116-2107380c0554 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:50.115070 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 126/254] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 00:38:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:50.118804 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd0255-10ff-4d7a-9f4e-01184f7251f9 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:50.119096 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd0255-10ff-4d7a-9f4e-01184f7251f9 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:50.119476 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd0255-10ff-4d7a-9f4e-01184f7251f9 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:50.121494 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 127/255] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:50.122286 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd0255-10ff-4d7a-9f4e-01184f7251f9 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:50.187980 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:50.203949 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 129/256] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:38:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:38:50.204731 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2c201-e127-4ea1-b1c3-aca65c42a10b None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:50.260072 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd0255-10ff-4d7a-9f4e-01184f7251f9 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:50.303847 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9865c-e790-4f97-b1cc-599064b4c3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:50.304556 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9865c-e790-4f97-b1cc-599064b4c3ce None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:50.304906 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9865c-e790-4f97-b1cc-599064b4c3ce None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:50.305255 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9865c-e790-4f97-b1cc-599064b4c3ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:50.306149 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c9865c-e790-4f97-b1cc-599064b4c3ce None admin] RBAC: Adding query filter params (role.id=1b52a0b7aac8436d9924035295f57093, scope.project.id=0cb207b03a6c4bee8b0f421096a2b4fc, user.id=8bb174dbd4f74861a7ef5430726d0ffa) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:50.306527 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c9865c-e790-4f97-b1cc-599064b4c3ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:50.308715 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c9865c-e790-4f97-b1cc-599064b4c3ce None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:50.315075 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 128/257] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 00:38:50 2022] GET /identity/v3/role_assignments?user.id=8bb174dbd4f74861a7ef5430726d0ffa&scope.project.id=0cb207b03a6c4bee8b0f421096a2b4fc&role.id=1b52a0b7aac8436d9924035295f57093 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:50.315648 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:50.316564 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d07717-db6b-4306-9724-535cb1b4c59b None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:50.316908 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d07717-db6b-4306-9724-535cb1b4c59b None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:50.317278 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d07717-db6b-4306-9724-535cb1b4c59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:50.343100 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2c201-e127-4ea1-b1c3-aca65c42a10b None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:50.350077 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-a1d07717-db6b-4306-9724-535cb1b4c59b None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:50.351398 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-a1d07717-db6b-4306-9724-535cb1b4c59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:50.392554 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751202c-f885-4536-b66b-0c73de9504ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:50.393341 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751202c-f885-4536-b66b-0c73de9504ce None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:50.393748 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751202c-f885-4536-b66b-0c73de9504ce None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:50.394023 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751202c-f885-4536-b66b-0c73de9504ce None admin] PATH_INFO: `/v3/users/a1df79c637df4efba54b47bb6811fce2` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:50.395273 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751202c-f885-4536-b66b-0c73de9504ce None admin] RBAC: Authorizing `identity:get_user(user_id=a1df79c637df4efba54b47bb6811fce2)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:50.399632 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751202c-f885-4536-b66b-0c73de9504ce None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:50.401453 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 130/258] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:38:50 2022] GET /identity/v3/users/a1df79c637df4efba54b47bb6811fce2 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:50.402319 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751202c-f885-4536-b66b-0c73de9504ce None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:50.538857 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 129/259] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:50.540081 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d07717-db6b-4306-9724-535cb1b4c59b None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:50.589516 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751202c-f885-4536-b66b-0c73de9504ce None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:50.607052 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:50.649564 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e52b2-2dd8-4cf5-8c5b-4755448e1e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:50.650212 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e52b2-2dd8-4cf5-8c5b-4755448e1e13 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:50.650492 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e52b2-2dd8-4cf5-8c5b-4755448e1e13 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:50.650766 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e52b2-2dd8-4cf5-8c5b-4755448e1e13 None admin] PATH_INFO: `/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:50.656581 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e52b2-2dd8-4cf5-8c5b-4755448e1e13 None admin] RBAC: Authorizing `identity:get_project(project_id=0cb207b03a6c4bee8b0f421096a2b4fc)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:50.658271 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e52b2-2dd8-4cf5-8c5b-4755448e1e13 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:50.660129 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 131/260] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:38:50 2022] GET /identity/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:50.666251 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e52b2-2dd8-4cf5-8c5b-4755448e1e13 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:50.709730 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:50.781520 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d07717-db6b-4306-9724-535cb1b4c59b None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:50.887669 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef13118-bb66-4ce8-a340-09268b3d4594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:50.888242 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef13118-bb66-4ce8-a340-09268b3d4594 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:50.888520 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef13118-bb66-4ce8-a340-09268b3d4594 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:50.888793 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef13118-bb66-4ce8-a340-09268b3d4594 None admin] PATH_INFO: `/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:50.889995 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef13118-bb66-4ce8-a340-09268b3d4594 None admin] RBAC: Authorizing `identity:get_project(project_id=0cb207b03a6c4bee8b0f421096a2b4fc)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:50.891450 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef13118-bb66-4ce8-a340-09268b3d4594 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:50.893311 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 130/261] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:38:50 2022] GET /identity/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc => generated 302 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:50.894885 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e52b2-2dd8-4cf5-8c5b-4755448e1e13 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:50.906362 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef13118-bb66-4ce8-a340-09268b3d4594 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:51.002167 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79091a1c-02d3-41be-8ee2-af07dd8bcc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:51.002918 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79091a1c-02d3-41be-8ee2-af07dd8bcc43 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:51.003281 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79091a1c-02d3-41be-8ee2-af07dd8bcc43 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:51.003646 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79091a1c-02d3-41be-8ee2-af07dd8bcc43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:51.004452 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79091a1c-02d3-41be-8ee2-af07dd8bcc43 None admin] RBAC: Adding query filter params (role.id=f13055bcebf847bf8b46160ded13810b, scope.project.id=0cb207b03a6c4bee8b0f421096a2b4fc, user.id=d6c54fc2c7484b03b985896b2bcaa1ea) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:51.004841 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79091a1c-02d3-41be-8ee2-af07dd8bcc43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:51.006444 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79091a1c-02d3-41be-8ee2-af07dd8bcc43 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:51.019653 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 132/262] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 00:38:50 2022] GET /identity/v3/role_assignments?user.id=d6c54fc2c7484b03b985896b2bcaa1ea&scope.project.id=0cb207b03a6c4bee8b0f421096a2b4fc&role.id=f13055bcebf847bf8b46160ded13810b => generated 608 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:38:51.094375 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef13118-bb66-4ce8-a340-09268b3d4594 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:51.098020 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:51.102580 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79091a1c-02d3-41be-8ee2-af07dd8bcc43 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:51.142468 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac32cf-b1db-48af-93e6-37552fb4ab1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:51.143524 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac32cf-b1db-48af-93e6-37552fb4ab1e None admin] REQUEST_METHOD: `PUT` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:51.144010 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac32cf-b1db-48af-93e6-37552fb4ab1e None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:51.144491 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac32cf-b1db-48af-93e6-37552fb4ab1e None admin] PATH_INFO: `/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc/users/a1df79c637df4efba54b47bb6811fce2/roles/64e752fa5df040c1a0b12914b5dacd49` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:51.146991 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac32cf-b1db-48af-93e6-37552fb4ab1e None admin] RBAC: Authorizing `identity:create_grant(project_id=0cb207b03a6c4bee8b0f421096a2b4fc, user_id=a1df79c637df4efba54b47bb6811fce2, role_id=64e752fa5df040c1a0b12914b5dacd49)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:51.149077 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac32cf-b1db-48af-93e6-37552fb4ab1e None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:51.228622 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:51.256521 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79091a1c-02d3-41be-8ee2-af07dd8bcc43 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:51.309144 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04248da-d5bd-46f4-abf4-524be66e64e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:51.309833 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04248da-d5bd-46f4-abf4-524be66e64e7 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:51.310113 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04248da-d5bd-46f4-abf4-524be66e64e7 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:51.310386 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04248da-d5bd-46f4-abf4-524be66e64e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:51.331013 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04248da-d5bd-46f4-abf4-524be66e64e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:38:51.336480 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-a04248da-d5bd-46f4-abf4-524be66e64e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:38:51.336480 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:51.336480 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:51.336480 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:51.336480 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:51.336480 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:51.336480 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:51.336480 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:51.336480 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:51.336480 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:51.336480 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:51.336480 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:51.336480 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:38:51.336480 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:38:51.336480 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:38:51.336480 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:38:51.344871 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:38:51.344871 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:38:51.344871 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:38:51.344871 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:38:51.344871 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:51.344871 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:51.344871 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:51.344871 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:51.344871 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:51.344871 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:51.344871 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:51.344871 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:51.344871 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:51.344871 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:51.344871 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:51.344871 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:51.345689 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:51.345689 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:51.345689 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:51.345689 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:51.345689 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:38:51.345689 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:38:51.345689 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:38:51.345689 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:38:51.345689 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:38:51.345689 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:38:51.345689 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:38:51.345689 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:38:51.345689 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 133/263] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 00:38:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:38:51.345689 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04248da-d5bd-46f4-abf4-524be66e64e7 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:51.379143 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 131/264] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 00:38:50 2022] PUT /identity/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc/users/a1df79c637df4efba54b47bb6811fce2/roles/64e752fa5df040c1a0b12914b5dacd49 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:51.491623 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04248da-d5bd-46f4-abf4-524be66e64e7 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:51.536039 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13498ac3-2e1a-45bc-863a-182105068218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:51.536674 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13498ac3-2e1a-45bc-863a-182105068218 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:51.537012 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13498ac3-2e1a-45bc-863a-182105068218 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:51.537291 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13498ac3-2e1a-45bc-863a-182105068218 None admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:51.538035 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13498ac3-2e1a-45bc-863a-182105068218 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:51.538340 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13498ac3-2e1a-45bc-863a-182105068218 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:51.539780 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13498ac3-2e1a-45bc-863a-182105068218 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:51.552951 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 134/265] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:38:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:38:51.559201 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac32cf-b1db-48af-93e6-37552fb4ab1e None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:51.693346 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac32cf-b1db-48af-93e6-37552fb4ab1e None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:51.734801 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8ea62-75bf-4630-a3c8-b546f286ffbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:51.735445 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8ea62-75bf-4630-a3c8-b546f286ffbf None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:51.735789 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8ea62-75bf-4630-a3c8-b546f286ffbf None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:51.736071 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8ea62-75bf-4630-a3c8-b546f286ffbf None admin] PATH_INFO: `/v3/users/d6c54fc2c7484b03b985896b2bcaa1ea` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:51.737339 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c8ea62-75bf-4630-a3c8-b546f286ffbf None admin] RBAC: Authorizing `identity:get_user(user_id=d6c54fc2c7484b03b985896b2bcaa1ea)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:51.738844 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c8ea62-75bf-4630-a3c8-b546f286ffbf None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:51.745537 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 132/266] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:38:51 2022] GET /identity/v3/users/d6c54fc2c7484b03b985896b2bcaa1ea => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:51.746824 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13498ac3-2e1a-45bc-863a-182105068218 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:51.751521 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:51.872095 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13498ac3-2e1a-45bc-863a-182105068218 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:51.930576 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a20c3-c2fd-43a8-9355-4806bd6c0675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:51.931239 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a20c3-c2fd-43a8-9355-4806bd6c0675 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:51.931451 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a20c3-c2fd-43a8-9355-4806bd6c0675 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:51.931719 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a20c3-c2fd-43a8-9355-4806bd6c0675 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:52.042000 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a20c3-c2fd-43a8-9355-4806bd6c0675 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:52.044889 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a20c3-c2fd-43a8-9355-4806bd6c0675 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:52.047709 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:52.190769 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 135/267] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:38:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:38:52.196074 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8ea62-75bf-4630-a3c8-b546f286ffbf None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:52.215748 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadfec3-720d-4e6e-9f65-ed59888b5947 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:52.216071 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadfec3-720d-4e6e-9f65-ed59888b5947 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:52.216337 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadfec3-720d-4e6e-9f65-ed59888b5947 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:52.218985 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 136/268] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:38:52.225309 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e5167-216e-4969-8ade-e83b98ea01ea None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:52.225819 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e5167-216e-4969-8ade-e83b98ea01ea None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:52.226100 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e5167-216e-4969-8ade-e83b98ea01ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:52.248477 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-069e5167-216e-4969-8ade-e83b98ea01ea None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:52.250079 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-069e5167-216e-4969-8ade-e83b98ea01ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:52.256193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:52.378583 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8ea62-75bf-4630-a3c8-b546f286ffbf None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:52.380624 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 137/269] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:38:52.435842 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072dccd-b4f4-4fd2-9b58-dd6e75e39fca None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:52.436390 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072dccd-b4f4-4fd2-9b58-dd6e75e39fca None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:52.436814 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072dccd-b4f4-4fd2-9b58-dd6e75e39fca None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:52.436937 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b63c3-90b9-4bd5-926f-736b73ca2db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:52.437593 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b63c3-90b9-4bd5-926f-736b73ca2db2 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:52.437873 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b63c3-90b9-4bd5-926f-736b73ca2db2 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:52.438144 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b63c3-90b9-4bd5-926f-736b73ca2db2 None admin] PATH_INFO: `/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:52.440642 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 138/270] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:38:52.442109 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b63c3-90b9-4bd5-926f-736b73ca2db2 None admin] RBAC: Authorizing `identity:get_project(project_id=0cb207b03a6c4bee8b0f421096a2b4fc)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:52.443613 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b63c3-90b9-4bd5-926f-736b73ca2db2 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:52.445671 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 133/271] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:38:52 2022] GET /identity/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:52.445898 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a8256-4e49-466c-ba26-a4dcc09232a1 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:52.446369 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a8256-4e49-466c-ba26-a4dcc09232a1 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:52.446906 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a8256-4e49-466c-ba26-a4dcc09232a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:52.452162 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b63c3-90b9-4bd5-926f-736b73ca2db2 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:52.468512 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-e42a8256-4e49-466c-ba26-a4dcc09232a1 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:52.470251 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-e42a8256-4e49-466c-ba26-a4dcc09232a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:52.502363 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:52.549719 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 139/272] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:38:52.631842 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:52.635305 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b63c3-90b9-4bd5-926f-736b73ca2db2 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:52.671073 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d8778-dd52-456d-a182-9386d5ac2824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:52.671684 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d8778-dd52-456d-a182-9386d5ac2824 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:52.672007 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d8778-dd52-456d-a182-9386d5ac2824 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:52.672281 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d8778-dd52-456d-a182-9386d5ac2824 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:52.673008 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d8778-dd52-456d-a182-9386d5ac2824 None admin] RBAC: Adding query filter params (role.id=f0a369eda5014bb78b2d752c9abef48f, scope.project.id=0cb207b03a6c4bee8b0f421096a2b4fc, user.id=d6c54fc2c7484b03b985896b2bcaa1ea) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:52.673315 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d8778-dd52-456d-a182-9386d5ac2824 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:52.674774 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d8778-dd52-456d-a182-9386d5ac2824 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:52.681206 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 134/273] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 00:38:52 2022] GET /identity/v3/role_assignments?user.id=d6c54fc2c7484b03b985896b2bcaa1ea&scope.project.id=0cb207b03a6c4bee8b0f421096a2b4fc&role.id=f0a369eda5014bb78b2d752c9abef48f => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:38:52.832603 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a8256-4e49-466c-ba26-a4dcc09232a1 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:52.958054 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a8256-4e49-466c-ba26-a4dcc09232a1 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:53.000355 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d86d09-83ed-4ebb-b689-5b0ead01065e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:53.000997 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d86d09-83ed-4ebb-b689-5b0ead01065e None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:53.001277 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d86d09-83ed-4ebb-b689-5b0ead01065e None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:53.001578 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d86d09-83ed-4ebb-b689-5b0ead01065e None admin] PATH_INFO: `/v3/domains/default` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:53.002689 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d86d09-83ed-4ebb-b689-5b0ead01065e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:53.004129 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d86d09-83ed-4ebb-b689-5b0ead01065e None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:53.006024 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 140/274] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:38:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:53.011974 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d8778-dd52-456d-a182-9386d5ac2824 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:53.022345 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d86d09-83ed-4ebb-b689-5b0ead01065e None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:53.078558 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:53.173880 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d8778-dd52-456d-a182-9386d5ac2824 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:53.182240 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d86d09-83ed-4ebb-b689-5b0ead01065e None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:53.216250 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79ea64-2794-4090-9b2a-969b808491fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:53.217219 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79ea64-2794-4090-9b2a-969b808491fd None admin] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:53.217766 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79ea64-2794-4090-9b2a-969b808491fd None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:53.217965 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79ea64-2794-4090-9b2a-969b808491fd None admin] PATH_INFO: `/v3/users` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:53.218610 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79ea64-2794-4090-9b2a-969b808491fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:53.220079 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79ea64-2794-4090-9b2a-969b808491fd None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:53.226299 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3715871-e5e1-472c-9626-74eec260f8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:53.227186 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3715871-e5e1-472c-9626-74eec260f8d8 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:53.227678 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3715871-e5e1-472c-9626-74eec260f8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:53.228161 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3715871-e5e1-472c-9626-74eec260f8d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:53.243029 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3715871-e5e1-472c-9626-74eec260f8d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:38:53.249049 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-f3715871-e5e1-472c-9626-74eec260f8d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:38:53.249049 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:53.249049 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:53.249049 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:53.249049 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:53.249049 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:53.249049 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:53.249049 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:53.249049 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:53.249049 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:53.249049 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:53.249049 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:53.249049 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:38:53.249049 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:38:53.249049 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:38:53.249049 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:38:53.250022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:38:53.250022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:38:53.250022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:38:53.250022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:38:53.250022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:53.250022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:53.250022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:53.250022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:53.250022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:53.250022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:53.250022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:53.250022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:53.250022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:53.250022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:53.250022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:53.250022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:53.250846 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:53.250846 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:53.250846 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:53.250846 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:53.250846 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:38:53.250846 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:38:53.250846 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:38:53.250846 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:38:53.250846 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:38:53.250846 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:38:53.250846 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:38:53.250846 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:38:53.251660 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 141/275] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:38:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:38:53.256873 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3715871-e5e1-472c-9626-74eec260f8d8 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:53.331343 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 135/276] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 26 00:38:53 2022] POST /identity/v3/users => generated 293 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:38:53.374813 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:53.387404 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3715871-e5e1-472c-9626-74eec260f8d8 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:53.430362 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b849c-0c81-4b1d-9f68-af12529b79b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:53.431459 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b849c-0c81-4b1d-9f68-af12529b79b1 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:53.431956 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b849c-0c81-4b1d-9f68-af12529b79b1 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:53.433034 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b849c-0c81-4b1d-9f68-af12529b79b1 None admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:53.433986 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b849c-0c81-4b1d-9f68-af12529b79b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:53.434528 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b849c-0c81-4b1d-9f68-af12529b79b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:53.436237 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b849c-0c81-4b1d-9f68-af12529b79b1 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:53.446918 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 142/277] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 00:38:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:53.453631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79ea64-2794-4090-9b2a-969b808491fd None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:53.478052 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:53.489324 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc8d32-399d-4b1e-828b-d3bd8667f33a None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:53.489655 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc8d32-399d-4b1e-828b-d3bd8667f33a None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:53.489937 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc8d32-399d-4b1e-828b-d3bd8667f33a None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:53.491667 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 143/278] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:38:53.498438 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7997eb9-03d1-41dc-b784-258843e4faa8 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:53.498729 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7997eb9-03d1-41dc-b784-258843e4faa8 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:53.501407 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7997eb9-03d1-41dc-b784-258843e4faa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:53.520726 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-d7997eb9-03d1-41dc-b784-258843e4faa8 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:53.522266 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-d7997eb9-03d1-41dc-b784-258843e4faa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:53.591329 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79ea64-2794-4090-9b2a-969b808491fd None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:53.610730 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 144/279] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:38:53.634328 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb45b21-753c-4296-a51d-31a39516dfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:53.635403 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb45b21-753c-4296-a51d-31a39516dfd5 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:53.635974 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb45b21-753c-4296-a51d-31a39516dfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:53.636483 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb45b21-753c-4296-a51d-31a39516dfd5 None admin] PATH_INFO: `/v3/users/c0cb7ec69e9e43a0866bcf0a35c9ff62` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:53.652180 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb45b21-753c-4296-a51d-31a39516dfd5 None admin] RBAC: Authorizing `identity:get_user(user_id=c0cb7ec69e9e43a0866bcf0a35c9ff62)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:53.653729 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb45b21-753c-4296-a51d-31a39516dfd5 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:53.655715 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 136/280] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:38:53 2022] GET /identity/v3/users/c0cb7ec69e9e43a0866bcf0a35c9ff62 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:53.661724 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7997eb9-03d1-41dc-b784-258843e4faa8 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:53.768755 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:53.789519 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7997eb9-03d1-41dc-b784-258843e4faa8 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:53.833133 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ee119-7d62-4bbc-ad30-29cb32437922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:53.834088 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ee119-7d62-4bbc-ad30-29cb32437922 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:53.834541 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ee119-7d62-4bbc-ad30-29cb32437922 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:53.834994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ee119-7d62-4bbc-ad30-29cb32437922 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:53.835892 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ee119-7d62-4bbc-ad30-29cb32437922 None admin] RBAC: Adding query filter params (role.id=64e752fa5df040c1a0b12914b5dacd49, user.id=c0cb7ec69e9e43a0866bcf0a35c9ff62, scope.system=all) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:53.836382 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ee119-7d62-4bbc-ad30-29cb32437922 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:53.838052 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ee119-7d62-4bbc-ad30-29cb32437922 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:53.848039 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 145/281] 10.222.0.20 () {56 vars in 1308 bytes} [Fri Aug 26 00:38:53 2022] GET /identity/v3/role_assignments?user.id=c0cb7ec69e9e43a0866bcf0a35c9ff62&scope.system=all&role.id=64e752fa5df040c1a0b12914b5dacd49 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:53.957583 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb45b21-753c-4296-a51d-31a39516dfd5 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:54.072958 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:54.100918 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb45b21-753c-4296-a51d-31a39516dfd5 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:54.142544 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b0bf2-e44b-436f-87d2-0b1311c50a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:54.143195 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b0bf2-e44b-436f-87d2-0b1311c50a3b None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:54.143476 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b0bf2-e44b-436f-87d2-0b1311c50a3b None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:54.143750 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b0bf2-e44b-436f-87d2-0b1311c50a3b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:54.155549 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fc767-9049-4e5a-a07c-7a9a8a96e706 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:54.156057 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fc767-9049-4e5a-a07c-7a9a8a96e706 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:54.156273 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fc767-9049-4e5a-a07c-7a9a8a96e706 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:54.157897 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 146/282] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:54.158006 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b0bf2-e44b-436f-87d2-0b1311c50a3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:38:54.163122 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-511b0bf2-e44b-436f-87d2-0b1311c50a3b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:38:54.163122 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:54.163122 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:54.163122 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:54.163122 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:54.163122 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:54.163122 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:54.163122 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:54.163122 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:54.163122 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:54.163122 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:54.163122 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:54.163122 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:38:54.163122 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:38:54.163122 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:38:54.163122 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:38:54.163977 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:38:54.163977 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:38:54.163977 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:38:54.163977 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:38:54.163977 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:54.163977 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:54.163977 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:54.163977 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:54.163977 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:54.163977 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:54.163977 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:54.163977 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:54.163977 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:54.163977 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:54.163977 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:54.163977 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:54.164805 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:54.164805 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:54.164805 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:54.164805 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:54.164805 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:38:54.164805 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:38:54.164805 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:38:54.164805 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:38:54.164805 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:38:54.164805 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:38:54.164805 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:38:54.164805 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:38:54.166666 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 137/283] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:38:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:38:54.171393 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57160124-107c-433f-93a8-27c54a250954 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:54.171965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57160124-107c-433f-93a8-27c54a250954 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:54.172183 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57160124-107c-433f-93a8-27c54a250954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:54.172616 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b0bf2-e44b-436f-87d2-0b1311c50a3b None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:54.210948 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-57160124-107c-433f-93a8-27c54a250954 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:54.213869 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-57160124-107c-433f-93a8-27c54a250954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:54.363104 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 147/284] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:54.374952 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b0bf2-e44b-436f-87d2-0b1311c50a3b None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:54.412341 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64175f2-31c9-46f1-ba70-72d6848fb5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:54.413485 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64175f2-31c9-46f1-ba70-72d6848fb5c1 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:54.413971 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64175f2-31c9-46f1-ba70-72d6848fb5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:54.414442 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64175f2-31c9-46f1-ba70-72d6848fb5c1 None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:54.415325 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64175f2-31c9-46f1-ba70-72d6848fb5c1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:54.415836 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64175f2-31c9-46f1-ba70-72d6848fb5c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:54.417474 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64175f2-31c9-46f1-ba70-72d6848fb5c1 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:54.420869 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:54.432510 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 138/285] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 00:38:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:38:54.434429 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57160124-107c-433f-93a8-27c54a250954 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:54.563813 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:54.595141 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57160124-107c-433f-93a8-27c54a250954 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:54.650197 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cb9c2-0b54-477c-bd2f-f40a8336025a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:54.650868 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cb9c2-0b54-477c-bd2f-f40a8336025a None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:54.651838 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cb9c2-0b54-477c-bd2f-f40a8336025a None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:54.652214 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cb9c2-0b54-477c-bd2f-f40a8336025a None admin] PATH_INFO: `/v3/users/8bb174dbd4f74861a7ef5430726d0ffa` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:54.653674 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26cb9c2-0b54-477c-bd2f-f40a8336025a None admin] RBAC: Authorizing `identity:get_user(user_id=8bb174dbd4f74861a7ef5430726d0ffa)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:54.655125 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26cb9c2-0b54-477c-bd2f-f40a8336025a None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:54.657081 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 148/286] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:38:54 2022] GET /identity/v3/users/8bb174dbd4f74861a7ef5430726d0ffa => generated 297 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:38:54.662793 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64175f2-31c9-46f1-ba70-72d6848fb5c1 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:54.815724 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cb9c2-0b54-477c-bd2f-f40a8336025a None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:54.843798 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64175f2-31c9-46f1-ba70-72d6848fb5c1 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:54.909685 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90443e78-173d-487f-af1b-5d5b4dd4470d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:54.909685 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90443e78-173d-487f-af1b-5d5b4dd4470d None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:54.909685 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90443e78-173d-487f-af1b-5d5b4dd4470d None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:54.909685 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90443e78-173d-487f-af1b-5d5b4dd4470d None admin] PATH_INFO: `/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:54.914138 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90443e78-173d-487f-af1b-5d5b4dd4470d None admin] RBAC: Authorizing `identity:get_project(project_id=0cb207b03a6c4bee8b0f421096a2b4fc)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:54.915643 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90443e78-173d-487f-af1b-5d5b4dd4470d None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:54.921408 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 139/287] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:38:54 2022] GET /identity/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:54.926158 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90443e78-173d-487f-af1b-5d5b4dd4470d None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:54.985044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cb9c2-0b54-477c-bd2f-f40a8336025a None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:55.060531 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43808e-c6fb-4844-a854-cc863887d40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:55.061573 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43808e-c6fb-4844-a854-cc863887d40d None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:55.062087 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43808e-c6fb-4844-a854-cc863887d40d None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:55.062594 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43808e-c6fb-4844-a854-cc863887d40d None admin] PATH_INFO: `/v3/roles/member` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:55.069727 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:55.088500 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43808e-c6fb-4844-a854-cc863887d40d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:38:55.094185 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-4a43808e-c6fb-4844-a854-cc863887d40d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:38:55.094185 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:55.094185 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:55.094185 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:55.094185 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:55.094185 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:55.094185 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:55.094185 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:55.094185 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:55.094185 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:55.094185 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:55.094185 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:55.094185 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:38:55.094185 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:38:55.094185 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:38:55.094185 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:38:55.095112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:38:55.095112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:38:55.095112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:38:55.095112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:38:55.095112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:55.095112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:55.095112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:55.095112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:55.095112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:55.095112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:55.095112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:55.095112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:55.095112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:55.095112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:55.095112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:55.095112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:55.096299 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:55.096299 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:55.096299 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:55.096299 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:55.096299 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:38:55.096299 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:38:55.096299 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:38:55.096299 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:38:55.096299 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:38:55.096299 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:38:55.096299 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:38:55.096299 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:38:55.096299 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 149/288] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:38:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:38:55.103371 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43808e-c6fb-4844-a854-cc863887d40d None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:55.110932 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:55.159149 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90443e78-173d-487f-af1b-5d5b4dd4470d None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:55.221976 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5ce5b-ca59-4221-87b4-8b5f9e0a94f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:55.224215 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5ce5b-ca59-4221-87b4-8b5f9e0a94f8 None admin] REQUEST_METHOD: `PUT` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:55.224956 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5ce5b-ca59-4221-87b4-8b5f9e0a94f8 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:55.226102 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5ce5b-ca59-4221-87b4-8b5f9e0a94f8 None admin] PATH_INFO: `/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc/users/8bb174dbd4f74861a7ef5430726d0ffa/roles/1b52a0b7aac8436d9924035295f57093` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:55.229577 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd5ce5b-ca59-4221-87b4-8b5f9e0a94f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0cb207b03a6c4bee8b0f421096a2b4fc, user_id=8bb174dbd4f74861a7ef5430726d0ffa, role_id=1b52a0b7aac8436d9924035295f57093)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:55.232831 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd5ce5b-ca59-4221-87b4-8b5f9e0a94f8 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:55.280643 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43808e-c6fb-4844-a854-cc863887d40d None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:55.349249 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 140/289] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 00:38:54 2022] PUT /identity/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc/users/8bb174dbd4f74861a7ef5430726d0ffa/roles/1b52a0b7aac8436d9924035295f57093 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:38:55.351414 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce6ccc-55af-4da6-bb17-a0f866b8329d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:55.352250 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce6ccc-55af-4da6-bb17-a0f866b8329d None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:55.352749 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce6ccc-55af-4da6-bb17-a0f866b8329d None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:55.353197 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce6ccc-55af-4da6-bb17-a0f866b8329d None admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:55.354144 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce6ccc-55af-4da6-bb17-a0f866b8329d None admin] RBAC: Adding query filter params (name=member) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:55.354779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce6ccc-55af-4da6-bb17-a0f866b8329d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:55.356534 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce6ccc-55af-4da6-bb17-a0f866b8329d None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:55.374375 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 150/290] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 00:38:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:38:55.380701 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5ce5b-ca59-4221-87b4-8b5f9e0a94f8 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:55.531566 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5ce5b-ca59-4221-87b4-8b5f9e0a94f8 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:55.568190 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:55.583826 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da74301-e283-48a9-89f0-6729da73009e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:55.584710 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da74301-e283-48a9-89f0-6729da73009e None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:55.585140 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da74301-e283-48a9-89f0-6729da73009e None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:55.585606 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da74301-e283-48a9-89f0-6729da73009e None admin] PATH_INFO: `/v3/users/a1df79c637df4efba54b47bb6811fce2` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:55.586902 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da74301-e283-48a9-89f0-6729da73009e None admin] RBAC: Authorizing `identity:get_user(user_id=a1df79c637df4efba54b47bb6811fce2)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:55.588559 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da74301-e283-48a9-89f0-6729da73009e None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:55.590926 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 141/291] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:38:55 2022] GET /identity/v3/users/a1df79c637df4efba54b47bb6811fce2 => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:55.596946 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce6ccc-55af-4da6-bb17-a0f866b8329d None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:55.681659 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:55.722977 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce6ccc-55af-4da6-bb17-a0f866b8329d None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:55.762588 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7879f6e-2e5e-4a9d-93bb-59d3f02e88d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:55.763218 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7879f6e-2e5e-4a9d-93bb-59d3f02e88d9 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:55.763505 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7879f6e-2e5e-4a9d-93bb-59d3f02e88d9 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:55.763780 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7879f6e-2e5e-4a9d-93bb-59d3f02e88d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:55.853096 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7879f6e-2e5e-4a9d-93bb-59d3f02e88d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:55.855334 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7879f6e-2e5e-4a9d-93bb-59d3f02e88d9 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:55.946560 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:55.975866 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 151/292] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:38:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:38:55.982458 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da74301-e283-48a9-89f0-6729da73009e None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:56.007974 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aed0f6-9445-4891-beac-75e27a93bfc2 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:56.008420 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aed0f6-9445-4891-beac-75e27a93bfc2 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:56.008828 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aed0f6-9445-4891-beac-75e27a93bfc2 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:56.010743 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 152/293] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:38:56.018400 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc84087-5d86-485b-9051-7f90edff358b None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:56.018836 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc84087-5d86-485b-9051-7f90edff358b None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:56.019221 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc84087-5d86-485b-9051-7f90edff358b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:56.039636 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-3bc84087-5d86-485b-9051-7f90edff358b None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:56.041065 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-3bc84087-5d86-485b-9051-7f90edff358b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:56.129725 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 153/294] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:56.176068 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da74301-e283-48a9-89f0-6729da73009e None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:56.216541 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1107577-0648-443d-8b16-c4df28de5c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:56.217471 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1107577-0648-443d-8b16-c4df28de5c4e None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:56.217925 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1107577-0648-443d-8b16-c4df28de5c4e None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:56.218368 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1107577-0648-443d-8b16-c4df28de5c4e None admin] PATH_INFO: `/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:56.219782 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1107577-0648-443d-8b16-c4df28de5c4e None admin] RBAC: Authorizing `identity:get_project(project_id=0cb207b03a6c4bee8b0f421096a2b4fc)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:56.221506 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1107577-0648-443d-8b16-c4df28de5c4e None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:56.223439 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 142/295] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:38:55 2022] GET /identity/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:56.230313 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc84087-5d86-485b-9051-7f90edff358b None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:56.365822 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:56.376409 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc84087-5d86-485b-9051-7f90edff358b None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:56.414999 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98c278-c22e-4231-9527-7d2ed307a2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:56.415624 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98c278-c22e-4231-9527-7d2ed307a2c3 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:56.415913 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98c278-c22e-4231-9527-7d2ed307a2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:56.416196 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98c278-c22e-4231-9527-7d2ed307a2c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:56.416972 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98c278-c22e-4231-9527-7d2ed307a2c3 None admin] RBAC: Adding query filter params (role.id=64e752fa5df040c1a0b12914b5dacd49, scope.project.id=0cb207b03a6c4bee8b0f421096a2b4fc, user.id=a1df79c637df4efba54b47bb6811fce2) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:56.417430 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98c278-c22e-4231-9527-7d2ed307a2c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:56.419238 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98c278-c22e-4231-9527-7d2ed307a2c3 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:56.426427 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 154/296] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 00:38:56 2022] GET /identity/v3/role_assignments?user.id=a1df79c637df4efba54b47bb6811fce2&scope.project.id=0cb207b03a6c4bee8b0f421096a2b4fc&role.id=64e752fa5df040c1a0b12914b5dacd49 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:56.516906 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1107577-0648-443d-8b16-c4df28de5c4e None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:56.613227 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:56.665394 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1107577-0648-443d-8b16-c4df28de5c4e None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:56.681137 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09397291-0e77-40f7-b4bc-725ef367f90d None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:56.681953 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09397291-0e77-40f7-b4bc-725ef367f90d None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:56.682531 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09397291-0e77-40f7-b4bc-725ef367f90d None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:56.685590 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 155/297] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:56.691534 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20178ed3-cf80-4438-be97-5d2fee293ddd None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:56.691825 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20178ed3-cf80-4438-be97-5d2fee293ddd None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:56.692093 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20178ed3-cf80-4438-be97-5d2fee293ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:56.718191 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c8ec3-a89b-4245-8d2c-8eb7fbd7b09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:56.718423 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c8ec3-a89b-4245-8d2c-8eb7fbd7b09d None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:56.718631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c8ec3-a89b-4245-8d2c-8eb7fbd7b09d None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:56.718870 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c8ec3-a89b-4245-8d2c-8eb7fbd7b09d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:56.720262 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-20178ed3-cf80-4438-be97-5d2fee293ddd None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:56.722885 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-20178ed3-cf80-4438-be97-5d2fee293ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:56.732490 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c8ec3-a89b-4245-8d2c-8eb7fbd7b09d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:38:56.739445 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-389c8ec3-a89b-4245-8d2c-8eb7fbd7b09d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:38:56.739445 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:56.739445 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:56.739445 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:56.739445 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:56.739445 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:56.739445 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:56.739445 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:56.739445 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:56.739445 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:56.739445 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:56.739445 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:56.739445 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:38:56.739445 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:38:56.739445 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:38:56.739445 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:38:56.740350 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:38:56.740350 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:38:56.740350 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:38:56.740350 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:38:56.740350 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:56.740350 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:56.740350 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:56.740350 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:56.740350 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:56.740350 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:56.740350 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:56.740350 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:56.740350 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:56.740350 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:56.740350 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:56.740350 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:56.741167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:56.741167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:56.741167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:56.741167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:56.741167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:38:56.741167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:38:56.741167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:38:56.741167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:38:56.741167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:38:56.741167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:38:56.741167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:38:56.741167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:38:56.741167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 143/298] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:38:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:38:56.748273 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c8ec3-a89b-4245-8d2c-8eb7fbd7b09d None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:56.827565 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 156/299] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:38:56.873687 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c8ec3-a89b-4245-8d2c-8eb7fbd7b09d None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:56.900996 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:56.920800 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526b7c9-f419-46f5-aede-cf878aba9cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:56.920800 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526b7c9-f419-46f5-aede-cf878aba9cb0 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:56.920800 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526b7c9-f419-46f5-aede-cf878aba9cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:56.920800 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526b7c9-f419-46f5-aede-cf878aba9cb0 None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:56.921199 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526b7c9-f419-46f5-aede-cf878aba9cb0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:56.921199 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526b7c9-f419-46f5-aede-cf878aba9cb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:56.921199 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526b7c9-f419-46f5-aede-cf878aba9cb0 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:56.937570 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 144/300] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 00:38:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:56.944928 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20178ed3-cf80-4438-be97-5d2fee293ddd None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:57.073782 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:57.080365 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20178ed3-cf80-4438-be97-5d2fee293ddd None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:57.114663 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69859f64-a6d9-429c-9cb6-7d006e1e8ee1 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:57.115203 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69859f64-a6d9-429c-9cb6-7d006e1e8ee1 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:57.115203 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69859f64-a6d9-429c-9cb6-7d006e1e8ee1 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:57.116552 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 145/301] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:57.122275 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f1553-7e0b-45cb-8d4f-d321cc054443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:57.122933 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f1553-7e0b-45cb-8d4f-d321cc054443 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:57.123219 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f1553-7e0b-45cb-8d4f-d321cc054443 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:57.123498 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f1553-7e0b-45cb-8d4f-d321cc054443 None admin] PATH_INFO: `/v3/users/dd598ebbcff846f3a30f0711b42774f8` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:57.124082 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8910d-ec68-4a7e-86d1-852ecdaa99b0 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:57.124563 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8910d-ec68-4a7e-86d1-852ecdaa99b0 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:57.125035 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8910d-ec68-4a7e-86d1-852ecdaa99b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:57.139949 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f1553-7e0b-45cb-8d4f-d321cc054443 None admin] RBAC: Authorizing `identity:get_user(user_id=dd598ebbcff846f3a30f0711b42774f8)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:57.141655 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f1553-7e0b-45cb-8d4f-d321cc054443 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:57.143599 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 157/302] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:38:56 2022] GET /identity/v3/users/dd598ebbcff846f3a30f0711b42774f8 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:57.149554 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f1553-7e0b-45cb-8d4f-d321cc054443 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:57.149867 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-a3e8910d-ec68-4a7e-86d1-852ecdaa99b0 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:57.152371 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-a3e8910d-ec68-4a7e-86d1-852ecdaa99b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:57.254610 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 146/303] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:38:57.255396 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8910d-ec68-4a7e-86d1-852ecdaa99b0 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:57.290950 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f1553-7e0b-45cb-8d4f-d321cc054443 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:57.345196 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d6bbc-c30e-4aa0-b396-3cbeb826c53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:57.345850 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d6bbc-c30e-4aa0-b396-3cbeb826c53f None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:57.346559 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d6bbc-c30e-4aa0-b396-3cbeb826c53f None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:57.346846 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d6bbc-c30e-4aa0-b396-3cbeb826c53f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:57.347892 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d6bbc-c30e-4aa0-b396-3cbeb826c53f None admin] RBAC: Adding query filter params (role.id=1b52a0b7aac8436d9924035295f57093, user.id=dd598ebbcff846f3a30f0711b42774f8, scope.system=all) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:57.348230 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d6bbc-c30e-4aa0-b396-3cbeb826c53f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:57.350622 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d6bbc-c30e-4aa0-b396-3cbeb826c53f None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:57.361419 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 158/304] 10.222.0.20 () {56 vars in 1308 bytes} [Fri Aug 26 00:38:57 2022] GET /identity/v3/role_assignments?user.id=dd598ebbcff846f3a30f0711b42774f8&scope.system=all&role.id=1b52a0b7aac8436d9924035295f57093 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:38:57.375617 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8910d-ec68-4a7e-86d1-852ecdaa99b0 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:57.396473 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:57.425687 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc728f46-9dc7-4962-a85f-a5f850e98e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:57.426354 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc728f46-9dc7-4962-a85f-a5f850e98e57 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:57.426637 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc728f46-9dc7-4962-a85f-a5f850e98e57 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:57.426911 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc728f46-9dc7-4962-a85f-a5f850e98e57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:57.428189 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc728f46-9dc7-4962-a85f-a5f850e98e57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:57.429767 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc728f46-9dc7-4962-a85f-a5f850e98e57 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:57.431929 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 147/305] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:38:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:57.438765 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d6bbc-c30e-4aa0-b396-3cbeb826c53f None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:57.457867 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:57.569425 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d6bbc-c30e-4aa0-b396-3cbeb826c53f None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:57.601627 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc728f46-9dc7-4962-a85f-a5f850e98e57 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:57.610457 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40c826-ca0e-44bf-bd66-3e5dbd8e7c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:57.611109 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40c826-ca0e-44bf-bd66-3e5dbd8e7c44 None admin] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:57.611391 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40c826-ca0e-44bf-bd66-3e5dbd8e7c44 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:57.611667 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40c826-ca0e-44bf-bd66-3e5dbd8e7c44 None admin] PATH_INFO: `/v3/groups` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:57.612310 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40c826-ca0e-44bf-bd66-3e5dbd8e7c44 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:57.613801 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40c826-ca0e-44bf-bd66-3e5dbd8e7c44 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:57.695270 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 159/306] 10.222.0.20 () {60 vars in 1134 bytes} [Fri Aug 26 00:38:57 2022] POST /identity/v3/groups => generated 229 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:57.735973 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc728f46-9dc7-4962-a85f-a5f850e98e57 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:57.794403 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8bfda-ca97-489c-a9a7-df3b1180486a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:57.795175 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8bfda-ca97-489c-a9a7-df3b1180486a None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:57.795466 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8bfda-ca97-489c-a9a7-df3b1180486a None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:57.795924 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8bfda-ca97-489c-a9a7-df3b1180486a None admin] PATH_INFO: `/v3/roles/member` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:57.814791 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8bfda-ca97-489c-a9a7-df3b1180486a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:38:57.822532 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-66e8bfda-ca97-489c-a9a7-df3b1180486a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:38:57.822532 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:57.822532 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:57.822532 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:57.822532 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:57.822532 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:57.822532 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:57.822532 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:57.822532 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:57.822532 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:57.822532 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:57.822532 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:57.822532 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:38:57.822532 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:38:57.822532 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:38:57.822532 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:38:57.824170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:38:57.824170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:38:57.824170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:38:57.824170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:38:57.824170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:57.824170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:57.824170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:57.824170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:57.824170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:57.824170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:57.824170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:57.824170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:57.824170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:57.824170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:57.824170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:57.824170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:57.824928 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:57.824928 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:57.824928 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:57.824928 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:57.824928 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:38:57.824928 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:38:57.824928 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:38:57.824928 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:38:57.824928 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:38:57.824928 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:38:57.824928 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:38:57.824928 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:38:57.826316 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 148/307] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:38:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:38:57.833283 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40c826-ca0e-44bf-bd66-3e5dbd8e7c44 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:57.924689 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:57.976809 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40c826-ca0e-44bf-bd66-3e5dbd8e7c44 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:58.041304 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54377a2-fdf3-4635-a4cb-253a5cb0c3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:58.042458 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54377a2-fdf3-4635-a4cb-253a5cb0c3d0 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:58.042963 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54377a2-fdf3-4635-a4cb-253a5cb0c3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:58.043473 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54377a2-fdf3-4635-a4cb-253a5cb0c3d0 None admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:58.044745 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54377a2-fdf3-4635-a4cb-253a5cb0c3d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:58.045320 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54377a2-fdf3-4635-a4cb-253a5cb0c3d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:58.048036 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54377a2-fdf3-4635-a4cb-253a5cb0c3d0 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:58.064962 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 160/308] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 00:38:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:58.075487 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8bfda-ca97-489c-a9a7-df3b1180486a None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:58.143593 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:58.209141 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8bfda-ca97-489c-a9a7-df3b1180486a None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:58.258621 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50106067-d5b4-4cff-95cb-58a6736ba897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:58.259289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50106067-d5b4-4cff-95cb-58a6736ba897 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:58.259610 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50106067-d5b4-4cff-95cb-58a6736ba897 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:58.259891 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50106067-d5b4-4cff-95cb-58a6736ba897 None admin] PATH_INFO: `/v3/users/c0cb7ec69e9e43a0866bcf0a35c9ff62` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:58.261144 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50106067-d5b4-4cff-95cb-58a6736ba897 None admin] RBAC: Authorizing `identity:get_user(user_id=c0cb7ec69e9e43a0866bcf0a35c9ff62)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:58.262796 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50106067-d5b4-4cff-95cb-58a6736ba897 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:58.264833 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 149/309] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:38:58 2022] GET /identity/v3/users/c0cb7ec69e9e43a0866bcf0a35c9ff62 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:58.270600 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54377a2-fdf3-4635-a4cb-253a5cb0c3d0 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:58.284757 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f269f44-ec1e-4656-936b-58ccbf882473 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:58.285426 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f269f44-ec1e-4656-936b-58ccbf882473 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:58.285908 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f269f44-ec1e-4656-936b-58ccbf882473 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:58.287493 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 150/310] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:58.293876 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e389d-7514-40f6-b8ea-484e3eaafccf None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:58.294466 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e389d-7514-40f6-b8ea-484e3eaafccf None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:58.294944 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e389d-7514-40f6-b8ea-484e3eaafccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:58.316787 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-192e389d-7514-40f6-b8ea-484e3eaafccf None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:58.318743 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-192e389d-7514-40f6-b8ea-484e3eaafccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:58.456482 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 151/311] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:38:58.458228 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54377a2-fdf3-4635-a4cb-253a5cb0c3d0 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:58.496556 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3b880-e457-42fd-8331-8026ea5bdae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:58.497673 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3b880-e457-42fd-8331-8026ea5bdae1 None admin] REQUEST_METHOD: `PUT` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:58.498259 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3b880-e457-42fd-8331-8026ea5bdae1 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:58.498742 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3b880-e457-42fd-8331-8026ea5bdae1 None admin] PATH_INFO: `/v3/system/users/c0cb7ec69e9e43a0866bcf0a35c9ff62/roles/64e752fa5df040c1a0b12914b5dacd49` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:58.500413 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3b880-e457-42fd-8331-8026ea5bdae1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c0cb7ec69e9e43a0866bcf0a35c9ff62, role_id=64e752fa5df040c1a0b12914b5dacd49)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:58.502073 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3b880-e457-42fd-8331-8026ea5bdae1 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:58.503914 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:58.596091 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 161/312] 10.222.0.20 () {58 vars in 1334 bytes} [Fri Aug 26 00:38:58 2022] PUT /identity/v3/system/users/c0cb7ec69e9e43a0866bcf0a35c9ff62/roles/64e752fa5df040c1a0b12914b5dacd49 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:58.959221 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e389d-7514-40f6-b8ea-484e3eaafccf None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:59.012169 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:59.078286 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e389d-7514-40f6-b8ea-484e3eaafccf None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:59.115326 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f429057-6e56-4a03-8077-9644a4f54446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:59.119051 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f429057-6e56-4a03-8077-9644a4f54446 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:59.119051 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f429057-6e56-4a03-8077-9644a4f54446 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:59.119051 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f429057-6e56-4a03-8077-9644a4f54446 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:59.128869 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f429057-6e56-4a03-8077-9644a4f54446 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:38:59.134212 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-8f429057-6e56-4a03-8077-9644a4f54446 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:38:59.134212 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:38:59.134212 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:38:59.134212 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:38:59.134212 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:38:59.134212 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:38:59.134212 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:38:59.134212 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:38:59.134212 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:38:59.134212 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:38:59.134212 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:38:59.134212 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:38:59.134212 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:38:59.134212 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:38:59.134212 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:38:59.134212 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:38:59.135126 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:38:59.135126 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:38:59.135126 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:38:59.135126 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:38:59.135126 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:38:59.135126 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:38:59.135126 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:38:59.135126 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:38:59.135126 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:38:59.135126 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:38:59.135126 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:38:59.135126 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:38:59.135126 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:38:59.135126 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:38:59.135126 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:38:59.135126 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:38:59.136049 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:38:59.136049 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:38:59.136049 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:38:59.136049 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:38:59.136049 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:38:59.136049 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:38:59.136049 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:38:59.136049 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:38:59.136049 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:38:59.136049 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:38:59.136049 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:38:59.136049 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:38:59.138338 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 152/313] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:38:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:38:59.144449 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3b880-e457-42fd-8331-8026ea5bdae1 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:59.252325 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3b880-e457-42fd-8331-8026ea5bdae1 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:59.288132 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b836b1-3589-4585-9d22-92ac3d9ed16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:59.288745 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b836b1-3589-4585-9d22-92ac3d9ed16f None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:59.289026 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b836b1-3589-4585-9d22-92ac3d9ed16f None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:59.289303 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b836b1-3589-4585-9d22-92ac3d9ed16f None admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:59.290074 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b836b1-3589-4585-9d22-92ac3d9ed16f None admin] RBAC: Adding query filter params (name=reader) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:59.290377 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b836b1-3589-4585-9d22-92ac3d9ed16f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:59.291897 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b836b1-3589-4585-9d22-92ac3d9ed16f None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:59.301430 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 162/314] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 00:38:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:59.307183 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f429057-6e56-4a03-8077-9644a4f54446 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:59.415406 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:59.418552 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f429057-6e56-4a03-8077-9644a4f54446 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:59.458853 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a0915-945d-425d-bfb5-f3d48e444ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:59.459502 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a0915-945d-425d-bfb5-f3d48e444ca4 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:59.459786 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a0915-945d-425d-bfb5-f3d48e444ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:59.460140 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a0915-945d-425d-bfb5-f3d48e444ca4 None admin] PATH_INFO: `/v3/users/8bb174dbd4f74861a7ef5430726d0ffa` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:59.461321 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a0915-945d-425d-bfb5-f3d48e444ca4 None admin] RBAC: Authorizing `identity:get_user(user_id=8bb174dbd4f74861a7ef5430726d0ffa)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:59.462821 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a0915-945d-425d-bfb5-f3d48e444ca4 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:59.465093 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 153/315] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:38:59 2022] GET /identity/v3/users/8bb174dbd4f74861a7ef5430726d0ffa => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:59.471390 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b836b1-3589-4585-9d22-92ac3d9ed16f None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:59.544073 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:59.592691 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b836b1-3589-4585-9d22-92ac3d9ed16f None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:59.628587 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66a6b4-aa74-42e6-a8a4-e76392b3af36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:59.629225 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66a6b4-aa74-42e6-a8a4-e76392b3af36 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:59.629545 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66a6b4-aa74-42e6-a8a4-e76392b3af36 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:59.629823 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66a6b4-aa74-42e6-a8a4-e76392b3af36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:59.718515 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66a6b4-aa74-42e6-a8a4-e76392b3af36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:59.720011 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66a6b4-aa74-42e6-a8a4-e76392b3af36 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:59.785169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:59.811071 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd95a7-5843-4f00-bf2e-08495284f552 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:59.811252 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd95a7-5843-4f00-bf2e-08495284f552 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:59.811539 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd95a7-5843-4f00-bf2e-08495284f552 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:59.813072 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 154/316] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:38:59.818488 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b619a-8957-4c28-8978-cc5d9f668ef8 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:59.819095 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b619a-8957-4c28-8978-cc5d9f668ef8 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:59.819437 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b619a-8957-4c28-8978-cc5d9f668ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:59.843652 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-d80b619a-8957-4c28-8978-cc5d9f668ef8 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:59.844572 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 163/317] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:38:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:38:59.845352 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-d80b619a-8957-4c28-8978-cc5d9f668ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:59.851440 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66a6b4-aa74-42e6-a8a4-e76392b3af36 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:59.939844 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 155/318] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:38:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:38:59.983521 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66a6b4-aa74-42e6-a8a4-e76392b3af36 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:00.026474 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6459c-b8f6-41bf-8d06-97484f63727c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:00.027528 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6459c-b8f6-41bf-8d06-97484f63727c None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:00.028051 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6459c-b8f6-41bf-8d06-97484f63727c None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:00.028414 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6459c-b8f6-41bf-8d06-97484f63727c None admin] PATH_INFO: `/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:00.029591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6459c-b8f6-41bf-8d06-97484f63727c None admin] RBAC: Authorizing `identity:get_project(project_id=0cb207b03a6c4bee8b0f421096a2b4fc)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:00.031113 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6459c-b8f6-41bf-8d06-97484f63727c None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:00.032744 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 164/319] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:38:59 2022] GET /identity/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:00.038903 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b619a-8957-4c28-8978-cc5d9f668ef8 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:00.184738 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:00.189038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b619a-8957-4c28-8978-cc5d9f668ef8 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:00.226868 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d84f7b-2441-46d7-95e0-86e66b2e35bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:00.227503 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d84f7b-2441-46d7-95e0-86e66b2e35bb None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:00.227786 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d84f7b-2441-46d7-95e0-86e66b2e35bb None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:00.228068 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d84f7b-2441-46d7-95e0-86e66b2e35bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:00.228911 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d84f7b-2441-46d7-95e0-86e66b2e35bb None admin] RBAC: Adding query filter params (role.id=1b52a0b7aac8436d9924035295f57093, scope.project.id=0cb207b03a6c4bee8b0f421096a2b4fc, user.id=8bb174dbd4f74861a7ef5430726d0ffa) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:00.229576 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d84f7b-2441-46d7-95e0-86e66b2e35bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:00.231071 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d84f7b-2441-46d7-95e0-86e66b2e35bb None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:00.244092 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 156/320] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 00:39:00 2022] GET /identity/v3/role_assignments?user.id=8bb174dbd4f74861a7ef5430726d0ffa&scope.project.id=0cb207b03a6c4bee8b0f421096a2b4fc&role.id=1b52a0b7aac8436d9924035295f57093 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:00.287977 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d84f7b-2441-46d7-95e0-86e66b2e35bb None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:00.288427 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a905a38-4bbe-45d6-8bcc-1c1350c2e9d6 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:00.288824 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a905a38-4bbe-45d6-8bcc-1c1350c2e9d6 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:00.289206 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a905a38-4bbe-45d6-8bcc-1c1350c2e9d6 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:00.290809 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 165/321] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:00.296885 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038627f7-0943-4654-b968-d22a7582ef18 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:00.297325 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038627f7-0943-4654-b968-d22a7582ef18 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:00.297750 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038627f7-0943-4654-b968-d22a7582ef18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:00.317268 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-038627f7-0943-4654-b968-d22a7582ef18 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:00.318697 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-038627f7-0943-4654-b968-d22a7582ef18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:00.346564 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:00.410058 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 166/322] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:39:00.433736 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d84f7b-2441-46d7-95e0-86e66b2e35bb None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:00.476159 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f26fbb-cf73-462c-ada2-4260733530cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:00.476737 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f26fbb-cf73-462c-ada2-4260733530cb None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:00.477027 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f26fbb-cf73-462c-ada2-4260733530cb None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:00.477301 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f26fbb-cf73-462c-ada2-4260733530cb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:00.493565 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f26fbb-cf73-462c-ada2-4260733530cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:39:00.499516 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-f6f26fbb-cf73-462c-ada2-4260733530cb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:39:00.499516 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:00.499516 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:00.499516 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:00.499516 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:00.499516 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:00.499516 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:00.499516 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:00.499516 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:00.499516 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:00.499516 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:00.499516 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:00.499516 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:39:00.499516 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:39:00.499516 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:39:00.499516 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:39:00.500401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:39:00.500401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:39:00.500401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:39:00.500401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:39:00.500401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:00.500401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:00.500401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:00.500401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:00.500401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:00.500401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:00.500401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:00.500401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:00.500401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:00.500401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:00.500401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:00.500401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:00.501189 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:00.501189 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:00.501189 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:00.501189 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:00.501189 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:39:00.501189 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:39:00.501189 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:39:00.501189 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:39:00.501189 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:39:00.501189 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:39:00.501189 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:39:00.501189 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:00.501189 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 157/323] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:39:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:00.508300 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038627f7-0943-4654-b968-d22a7582ef18 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:00.647085 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038627f7-0943-4654-b968-d22a7582ef18 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:00.687264 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9d9e9-71a4-41ad-ba2f-eaf40b141fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:00.687893 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9d9e9-71a4-41ad-ba2f-eaf40b141fce None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:00.688203 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9d9e9-71a4-41ad-ba2f-eaf40b141fce None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:00.688534 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9d9e9-71a4-41ad-ba2f-eaf40b141fce None admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:00.689218 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca9d9e9-71a4-41ad-ba2f-eaf40b141fce None admin] RBAC: Adding query filter params (name=reader) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:00.689551 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca9d9e9-71a4-41ad-ba2f-eaf40b141fce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:00.690996 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca9d9e9-71a4-41ad-ba2f-eaf40b141fce None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:00.701866 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 167/324] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 00:39:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:00.707787 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f26fbb-cf73-462c-ada2-4260733530cb None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:00.741490 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:00.756218 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9d9e9-71a4-41ad-ba2f-eaf40b141fce None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:00.783480 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:00.849406 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f26fbb-cf73-462c-ada2-4260733530cb None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:00.888503 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db21c11-f7d6-4bbf-8586-93a512a73ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:00.889157 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db21c11-f7d6-4bbf-8586-93a512a73ae9 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:00.890864 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db21c11-f7d6-4bbf-8586-93a512a73ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:00.890864 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db21c11-f7d6-4bbf-8586-93a512a73ae9 None admin] PATH_INFO: `/v3/users/dd598ebbcff846f3a30f0711b42774f8` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:00.891985 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db21c11-f7d6-4bbf-8586-93a512a73ae9 None admin] RBAC: Authorizing `identity:get_user(user_id=dd598ebbcff846f3a30f0711b42774f8)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:00.893218 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9d9e9-71a4-41ad-ba2f-eaf40b141fce None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:00.893470 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db21c11-f7d6-4bbf-8586-93a512a73ae9 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:00.895232 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 158/325] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:39:00 2022] GET /identity/v3/users/dd598ebbcff846f3a30f0711b42774f8 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:00.900593 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db21c11-f7d6-4bbf-8586-93a512a73ae9 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:00.938547 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ba20e-beb9-417d-894b-6ba675cc9149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:00.939191 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ba20e-beb9-417d-894b-6ba675cc9149 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:00.939470 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ba20e-beb9-417d-894b-6ba675cc9149 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:00.939743 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ba20e-beb9-417d-894b-6ba675cc9149 None admin] PATH_INFO: `/v3/domains/default` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:00.940906 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ba20e-beb9-417d-894b-6ba675cc9149 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:00.942536 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ba20e-beb9-417d-894b-6ba675cc9149 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:00.944461 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 168/326] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:39:00.950304 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ba20e-beb9-417d-894b-6ba675cc9149 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:01.015438 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:01.025932 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db21c11-f7d6-4bbf-8586-93a512a73ae9 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:01.054872 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:01.066719 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbe1e2-a6b2-4359-970c-089089d1a13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:01.067390 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ba20e-beb9-417d-894b-6ba675cc9149 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:01.067502 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbe1e2-a6b2-4359-970c-089089d1a13e None admin] REQUEST_METHOD: `PUT` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:01.067670 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbe1e2-a6b2-4359-970c-089089d1a13e None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:01.067948 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbe1e2-a6b2-4359-970c-089089d1a13e None admin] PATH_INFO: `/v3/system/users/dd598ebbcff846f3a30f0711b42774f8/roles/1b52a0b7aac8436d9924035295f57093` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:01.069657 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cbe1e2-a6b2-4359-970c-089089d1a13e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=dd598ebbcff846f3a30f0711b42774f8, role_id=1b52a0b7aac8436d9924035295f57093)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:01.071070 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cbe1e2-a6b2-4359-970c-089089d1a13e None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:01.102101 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57215156-0454-4f16-9ba2-2c36883dc4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:01.103042 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57215156-0454-4f16-9ba2-2c36883dc4ac None admin] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:01.103042 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57215156-0454-4f16-9ba2-2c36883dc4ac None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:01.103252 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57215156-0454-4f16-9ba2-2c36883dc4ac None admin] PATH_INFO: `/v3/groups` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:01.103960 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57215156-0454-4f16-9ba2-2c36883dc4ac None admin] RBAC: Authorizing `identity:create_group()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:01.106059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57215156-0454-4f16-9ba2-2c36883dc4ac None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:01.167294 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 159/327] 10.222.0.20 () {58 vars in 1334 bytes} [Fri Aug 26 00:39:00 2022] PUT /identity/v3/system/users/dd598ebbcff846f3a30f0711b42774f8/roles/1b52a0b7aac8436d9924035295f57093 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:39:01.168626 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833c31d-72a8-460a-bfec-dbf8a872cebb None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:01.168919 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833c31d-72a8-460a-bfec-dbf8a872cebb None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:01.169199 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833c31d-72a8-460a-bfec-dbf8a872cebb None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:01.170628 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 160/328] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:01.176913 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413d20f-aff2-4707-ad1e-4783e6942512 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:01.177205 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413d20f-aff2-4707-ad1e-4783e6942512 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:01.177600 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413d20f-aff2-4707-ad1e-4783e6942512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:01.197297 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-0413d20f-aff2-4707-ad1e-4783e6942512 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:01.199101 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-0413d20f-aff2-4707-ad1e-4783e6942512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:01.264551 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 169/329] 10.222.0.20 () {60 vars in 1134 bytes} [Fri Aug 26 00:39:00 2022] POST /identity/v3/groups => generated 226 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:39:01.290979 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 161/330] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:39:01.629956 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57215156-0454-4f16-9ba2-2c36883dc4ac None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:01.755213 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57215156-0454-4f16-9ba2-2c36883dc4ac None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:01.803584 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8007e-2134-45c7-bb1e-542829784401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:01.804232 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8007e-2134-45c7-bb1e-542829784401 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:01.804511 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8007e-2134-45c7-bb1e-542829784401 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:01.804789 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8007e-2134-45c7-bb1e-542829784401 None admin] PATH_INFO: `/v3/roles/member` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:01.819808 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8007e-2134-45c7-bb1e-542829784401 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:39:01.826743 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-d4a8007e-2134-45c7-bb1e-542829784401 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:39:01.826743 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:01.826743 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:01.826743 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:01.826743 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:01.826743 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:01.826743 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:01.826743 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:01.826743 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:01.826743 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:01.826743 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:01.826743 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:01.826743 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:39:01.826743 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:39:01.826743 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:39:01.826743 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:39:01.827877 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:39:01.827877 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:39:01.827877 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:39:01.827877 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:39:01.827877 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:01.827877 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:01.827877 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:01.827877 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:01.827877 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:01.827877 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:01.827877 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:01.827877 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:01.827877 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:01.827877 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:01.827877 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:01.827877 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:01.828932 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:01.828932 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:01.828932 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:01.828932 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:01.828932 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:39:01.828932 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:39:01.828932 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:39:01.828932 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:39:01.828932 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:39:01.828932 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:39:01.828932 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:39:01.828932 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:01.828932 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 170/331] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:39:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:01.834285 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413d20f-aff2-4707-ad1e-4783e6942512 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:01.973276 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:01.991716 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413d20f-aff2-4707-ad1e-4783e6942512 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:02.043965 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291420bb-f433-4aa5-bf4f-614aeb1a8818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:02.044607 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291420bb-f433-4aa5-bf4f-614aeb1a8818 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:02.044896 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291420bb-f433-4aa5-bf4f-614aeb1a8818 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:02.045177 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291420bb-f433-4aa5-bf4f-614aeb1a8818 None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:02.045979 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291420bb-f433-4aa5-bf4f-614aeb1a8818 None admin] RBAC: Adding query filter params (name=member) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:02.046292 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291420bb-f433-4aa5-bf4f-614aeb1a8818 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:02.047713 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291420bb-f433-4aa5-bf4f-614aeb1a8818 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:02.058658 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 162/332] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 00:39:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:02.064349 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8007e-2134-45c7-bb1e-542829784401 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:02.076904 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:02.180707 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8007e-2134-45c7-bb1e-542829784401 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:02.221624 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c27d1c-fa14-4b42-9c00-419b9a56bd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:02.222194 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c27d1c-fa14-4b42-9c00-419b9a56bd33 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:02.222471 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c27d1c-fa14-4b42-9c00-419b9a56bd33 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:02.222741 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c27d1c-fa14-4b42-9c00-419b9a56bd33 None admin] PATH_INFO: `/v3/users/c0cb7ec69e9e43a0866bcf0a35c9ff62` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:02.223992 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c27d1c-fa14-4b42-9c00-419b9a56bd33 None admin] RBAC: Authorizing `identity:get_user(user_id=c0cb7ec69e9e43a0866bcf0a35c9ff62)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:02.225504 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c27d1c-fa14-4b42-9c00-419b9a56bd33 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:02.227104 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 171/333] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:39:02 2022] GET /identity/v3/users/c0cb7ec69e9e43a0866bcf0a35c9ff62 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:02.233765 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291420bb-f433-4aa5-bf4f-614aeb1a8818 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:02.357781 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291420bb-f433-4aa5-bf4f-614aeb1a8818 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:02.405216 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3bd3e-435a-4c4b-bae6-f44286abb5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:02.405864 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3bd3e-435a-4c4b-bae6-f44286abb5e1 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:02.406148 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3bd3e-435a-4c4b-bae6-f44286abb5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:02.406423 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3bd3e-435a-4c4b-bae6-f44286abb5e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:02.407154 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3bd3e-435a-4c4b-bae6-f44286abb5e1 None admin] RBAC: Adding query filter params (role.id=64e752fa5df040c1a0b12914b5dacd49, user.id=c0cb7ec69e9e43a0866bcf0a35c9ff62, scope.system=all) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:02.407463 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3bd3e-435a-4c4b-bae6-f44286abb5e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:02.408945 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3bd3e-435a-4c4b-bae6-f44286abb5e1 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:02.421997 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 163/334] 10.222.0.20 () {56 vars in 1308 bytes} [Fri Aug 26 00:39:02 2022] GET /identity/v3/role_assignments?user.id=c0cb7ec69e9e43a0866bcf0a35c9ff62&scope.system=all&role.id=64e752fa5df040c1a0b12914b5dacd49 => generated 510 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:03.836819 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c5f89-c2e0-4b9a-8696-ce42b3e23c63 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:03.837356 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c5f89-c2e0-4b9a-8696-ce42b3e23c63 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:03.837356 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c5f89-c2e0-4b9a-8696-ce42b3e23c63 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:03.839549 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 172/335] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:03.845212 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b2b04-a88c-4af0-9293-2cdc8ad685c1 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:03.846170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b2b04-a88c-4af0-9293-2cdc8ad685c1 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:03.846751 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b2b04-a88c-4af0-9293-2cdc8ad685c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:03.859081 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:03.877973 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-da7b2b04-a88c-4af0-9293-2cdc8ad685c1 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:03.879296 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-da7b2b04-a88c-4af0-9293-2cdc8ad685c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:03.937331 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8613c55-1abe-47b5-87e1-41f2e61e1d11 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:03.937786 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8613c55-1abe-47b5-87e1-41f2e61e1d11 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:03.938049 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8613c55-1abe-47b5-87e1-41f2e61e1d11 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:03.939829 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 173/336] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:03.960326 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bbe81-ecd8-425b-b766-659596180962 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:03.960662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bbe81-ecd8-425b-b766-659596180962 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:03.960869 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bbe81-ecd8-425b-b766-659596180962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:03.990757 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-362bbe81-ecd8-425b-b766-659596180962 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:03.992977 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 164/337] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:39:03.993779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-362bbe81-ecd8-425b-b766-659596180962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:04.081348 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 174/338] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:39:04.460899 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b2b04-a88c-4af0-9293-2cdc8ad685c1 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:04.495543 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531549dc-2878-4cba-ba07-2e8ac12fb55d None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:04.496142 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531549dc-2878-4cba-ba07-2e8ac12fb55d None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:04.496280 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531549dc-2878-4cba-ba07-2e8ac12fb55d None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:04.505283 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 175/339] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:04.511198 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fecdc1-7ce0-42b8-9ef3-571a598e970e None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:04.511630 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fecdc1-7ce0-42b8-9ef3-571a598e970e None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:04.511867 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fecdc1-7ce0-42b8-9ef3-571a598e970e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:04.533986 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:04.540959 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-97fecdc1-7ce0-42b8-9ef3-571a598e970e None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:04.542781 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-97fecdc1-7ce0-42b8-9ef3-571a598e970e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:04.660620 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 176/340] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:39:04.664261 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fecdc1-7ce0-42b8-9ef3-571a598e970e None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:04.677625 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b2b04-a88c-4af0-9293-2cdc8ad685c1 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:04.777178 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d13eb-83ef-4545-b58b-8aa7b41b3a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:04.777763 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d13eb-83ef-4545-b58b-8aa7b41b3a94 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:04.778079 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d13eb-83ef-4545-b58b-8aa7b41b3a94 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:04.778359 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d13eb-83ef-4545-b58b-8aa7b41b3a94 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:04.785397 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:04.814729 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d13eb-83ef-4545-b58b-8aa7b41b3a94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:39:04.820446 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-ef7d13eb-83ef-4545-b58b-8aa7b41b3a94 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:39:04.820446 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:04.820446 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:04.820446 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:04.820446 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:04.820446 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:04.820446 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:04.820446 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:04.820446 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:04.820446 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:04.820446 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:04.820446 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:04.820446 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:39:04.820446 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:39:04.820446 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:39:04.820446 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:39:04.821806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:39:04.821806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:39:04.821806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:39:04.821806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:39:04.821806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:04.821806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:04.821806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:04.821806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:04.821806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:04.821806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:04.821806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:04.821806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:04.821806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:04.821806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:04.821806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:04.821806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:04.823819 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:04.823819 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:04.823819 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:04.823819 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:04.823819 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:39:04.823819 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:39:04.823819 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:39:04.823819 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:39:04.823819 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:39:04.823819 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:39:04.823819 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:39:04.823819 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:04.823819 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 165/341] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:39:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:04.829162 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d13eb-83ef-4545-b58b-8aa7b41b3a94 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:04.876597 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fecdc1-7ce0-42b8-9ef3-571a598e970e None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:04.956115 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a890c8-302c-4c75-8ea3-2e79b0e3fe5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:04.957131 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a890c8-302c-4c75-8ea3-2e79b0e3fe5b None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:04.957581 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a890c8-302c-4c75-8ea3-2e79b0e3fe5b None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:04.958009 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a890c8-302c-4c75-8ea3-2e79b0e3fe5b None admin] PATH_INFO: `/v3/roles/member` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:04.972561 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:04.980239 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a890c8-302c-4c75-8ea3-2e79b0e3fe5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:39:04.985660 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-e7a890c8-302c-4c75-8ea3-2e79b0e3fe5b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:39:04.985660 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:04.985660 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:04.985660 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:04.985660 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:04.985660 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:04.985660 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:04.985660 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:04.985660 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:04.985660 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:04.985660 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:04.985660 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:04.985660 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:39:04.985660 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:39:04.985660 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:39:04.985660 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:39:04.986802 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:39:04.986802 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:39:04.986802 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:39:04.986802 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:39:04.986802 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:04.986802 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:04.986802 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:04.986802 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:04.986802 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:04.986802 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:04.986802 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:04.986802 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:04.986802 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:04.986802 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:04.986802 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:04.986802 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:04.987813 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:04.987813 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:04.987813 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:04.987813 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:04.987813 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:39:04.987813 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:39:04.987813 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:39:04.987813 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:39:04.987813 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:39:04.987813 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:39:04.987813 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:39:04.987813 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:04.993956 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 177/342] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:39:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:05.003189 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a890c8-302c-4c75-8ea3-2e79b0e3fe5b None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:05.098571 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d13eb-83ef-4545-b58b-8aa7b41b3a94 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:05.155978 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a890c8-302c-4c75-8ea3-2e79b0e3fe5b None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:05.189156 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0c0b6-e228-4912-a6b3-0c4399894341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:05.189933 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0c0b6-e228-4912-a6b3-0c4399894341 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:05.190167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0c0b6-e228-4912-a6b3-0c4399894341 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:05.190473 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0c0b6-e228-4912-a6b3-0c4399894341 None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:05.191171 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c0c0b6-e228-4912-a6b3-0c4399894341 None admin] RBAC: Adding query filter params (name=reader) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:05.191520 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c0c0b6-e228-4912-a6b3-0c4399894341 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:05.192953 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c0c0b6-e228-4912-a6b3-0c4399894341 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:05.201215 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f482f-c9c5-4cf0-b645-977de312973f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:05.202113 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f482f-c9c5-4cf0-b645-977de312973f None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:05.202560 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f482f-c9c5-4cf0-b645-977de312973f None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:05.202972 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f482f-c9c5-4cf0-b645-977de312973f None admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:05.204314 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f482f-c9c5-4cf0-b645-977de312973f None admin] RBAC: Adding query filter params (name=member) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:05.204765 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f482f-c9c5-4cf0-b645-977de312973f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:05.206343 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f482f-c9c5-4cf0-b645-977de312973f None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:05.209540 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 166/343] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 00:39:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:05.210319 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0c0b6-e228-4912-a6b3-0c4399894341 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:05.217457 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 178/344] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 00:39:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:39:05.218658 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f482f-c9c5-4cf0-b645-977de312973f None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:05.311763 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:05.312959 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:05.343409 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f482f-c9c5-4cf0-b645-977de312973f None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:05.363370 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0c0b6-e228-4912-a6b3-0c4399894341 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:05.391493 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b44be-d21d-49f4-8b4c-15fbc3133277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:05.392137 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b44be-d21d-49f4-8b4c-15fbc3133277 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:05.392423 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b44be-d21d-49f4-8b4c-15fbc3133277 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:05.392702 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b44be-d21d-49f4-8b4c-15fbc3133277 None admin] PATH_INFO: `/v3/users/dd598ebbcff846f3a30f0711b42774f8` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:05.393996 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b44be-d21d-49f4-8b4c-15fbc3133277 None admin] RBAC: Authorizing `identity:get_user(user_id=dd598ebbcff846f3a30f0711b42774f8)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:05.395476 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b44be-d21d-49f4-8b4c-15fbc3133277 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:05.401558 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 179/345] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 26 00:39:05 2022] GET /identity/v3/users/dd598ebbcff846f3a30f0711b42774f8 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:05.402610 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b44be-d21d-49f4-8b4c-15fbc3133277 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:05.412934 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3880d27-fab2-4d75-80ba-d62da48f3f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:05.413821 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3880d27-fab2-4d75-80ba-d62da48f3f16 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:05.414245 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3880d27-fab2-4d75-80ba-d62da48f3f16 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:05.414661 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3880d27-fab2-4d75-80ba-d62da48f3f16 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:05.429195 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3880d27-fab2-4d75-80ba-d62da48f3f16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:39:05.438098 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-b3880d27-fab2-4d75-80ba-d62da48f3f16 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:39:05.438098 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:05.438098 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:05.438098 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:05.438098 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:05.438098 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:05.438098 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:05.438098 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:05.438098 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:05.438098 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:05.438098 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:05.438098 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:05.438098 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:39:05.438098 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:39:05.438098 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:39:05.438098 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:39:05.439254 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:39:05.439254 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:39:05.439254 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:39:05.439254 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:39:05.439254 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:05.439254 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:05.439254 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:05.439254 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:05.439254 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:05.439254 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:05.439254 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:05.439254 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:05.439254 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:05.439254 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:05.439254 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:05.439254 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:05.440249 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:05.440249 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:05.440249 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:05.440249 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:05.440249 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:39:05.440249 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:39:05.440249 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:39:05.440249 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:39:05.440249 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:39:05.440249 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:39:05.440249 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:39:05.440249 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:05.443330 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 167/346] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 00:39:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:05.444931 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3dec3-074e-47e9-81fc-135a4f6befd6 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:05.445537 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3dec3-074e-47e9-81fc-135a4f6befd6 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:05.445951 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3dec3-074e-47e9-81fc-135a4f6befd6 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:05.449932 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 168/347] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:05.450997 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3dec3-074e-47e9-81fc-135a4f6befd6 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:05.545132 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b44be-d21d-49f4-8b4c-15fbc3133277 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:05.579569 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:05.586724 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3dec3-074e-47e9-81fc-135a4f6befd6 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:05.591596 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f29f05-b092-420c-ab54-e8e33a503371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:05.592583 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f29f05-b092-420c-ab54-e8e33a503371 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:05.593094 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f29f05-b092-420c-ab54-e8e33a503371 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:05.593594 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f29f05-b092-420c-ab54-e8e33a503371 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:05.614154 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:05.634246 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe34f64-ae3d-4f79-a960-57a0932c1367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:05.635251 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe34f64-ae3d-4f79-a960-57a0932c1367 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:05.637674 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe34f64-ae3d-4f79-a960-57a0932c1367 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:05.637674 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe34f64-ae3d-4f79-a960-57a0932c1367 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:05.638415 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe34f64-ae3d-4f79-a960-57a0932c1367 None admin] RBAC: Adding query filter params (role.id=1b52a0b7aac8436d9924035295f57093, user.id=dd598ebbcff846f3a30f0711b42774f8, scope.system=all) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:05.638888 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe34f64-ae3d-4f79-a960-57a0932c1367 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:05.641424 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe34f64-ae3d-4f79-a960-57a0932c1367 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:05.660973 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 169/348] 10.222.0.20 () {56 vars in 1308 bytes} [Fri Aug 26 00:39:05 2022] GET /identity/v3/role_assignments?user.id=dd598ebbcff846f3a30f0711b42774f8&scope.system=all&role.id=1b52a0b7aac8436d9924035295f57093 => generated 510 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:05.663028 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe34f64-ae3d-4f79-a960-57a0932c1367 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:05.734250 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f29f05-b092-420c-ab54-e8e33a503371 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:05.739211 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f29f05-b092-420c-ab54-e8e33a503371 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:05.881978 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe34f64-ae3d-4f79-a960-57a0932c1367 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:05.905201 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 180/349] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:39:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:39:05.907337 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566cf03-1908-4bb6-bfe0-21fc926f355b None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:05.907837 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566cf03-1908-4bb6-bfe0-21fc926f355b None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:05.908365 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566cf03-1908-4bb6-bfe0-21fc926f355b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:05.934066 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-6566cf03-1908-4bb6-bfe0-21fc926f355b None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:05.936472 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-6566cf03-1908-4bb6-bfe0-21fc926f355b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:05.954743 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ba55a-3ae5-4f03-ade8-f1d870bfe286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:05.955449 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ba55a-3ae5-4f03-ade8-f1d870bfe286 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:05.955736 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ba55a-3ae5-4f03-ade8-f1d870bfe286 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:05.956015 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ba55a-3ae5-4f03-ade8-f1d870bfe286 None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:05.956727 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ba55a-3ae5-4f03-ade8-f1d870bfe286 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:05.957045 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ba55a-3ae5-4f03-ade8-f1d870bfe286 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:05.960716 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ba55a-3ae5-4f03-ade8-f1d870bfe286 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:05.982790 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 170/350] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:39:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:05.983457 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ba55a-3ae5-4f03-ade8-f1d870bfe286 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:05.991582 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:06.051752 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:06.066141 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 181/351] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:39:06.067499 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566cf03-1908-4bb6-bfe0-21fc926f355b None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:06.162445 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ba55a-3ae5-4f03-ade8-f1d870bfe286 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:06.208561 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f569053-6fe4-43c7-b03e-9a89c70ac4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:06.209226 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f569053-6fe4-43c7-b03e-9a89c70ac4f3 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:06.209552 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f569053-6fe4-43c7-b03e-9a89c70ac4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:06.209862 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f569053-6fe4-43c7-b03e-9a89c70ac4f3 None admin] PATH_INFO: `/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:06.213865 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f569053-6fe4-43c7-b03e-9a89c70ac4f3 None admin] RBAC: Authorizing `identity:get_project(project_id=dd1ea6c1f8214651a9e7c21e90adac21)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:06.213865 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f569053-6fe4-43c7-b03e-9a89c70ac4f3 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:06.215576 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 171/352] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:39:05 2022] GET /identity/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:06.221225 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f569053-6fe4-43c7-b03e-9a89c70ac4f3 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:06.305899 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566cf03-1908-4bb6-bfe0-21fc926f355b None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:06.362077 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f569053-6fe4-43c7-b03e-9a89c70ac4f3 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:06.365825 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:06.400869 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d06bb-6ded-4d34-8644-851757683d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:06.402597 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d06bb-6ded-4d34-8644-851757683d43 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:06.402597 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d06bb-6ded-4d34-8644-851757683d43 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:06.403023 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d06bb-6ded-4d34-8644-851757683d43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:06.408039 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7963daf-4112-4721-95ad-0713679dbf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:06.408973 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7963daf-4112-4721-95ad-0713679dbf09 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:06.409467 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7963daf-4112-4721-95ad-0713679dbf09 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:06.409898 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7963daf-4112-4721-95ad-0713679dbf09 None admin] PATH_INFO: `/v3/groups/57dd9a229f754fe0ba34ef400b3062cc` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:06.418621 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7963daf-4112-4721-95ad-0713679dbf09 None admin] RBAC: Authorizing `identity:get_group(group_id=57dd9a229f754fe0ba34ef400b3062cc)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:06.421040 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7963daf-4112-4721-95ad-0713679dbf09 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:06.423467 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 172/353] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 26 00:39:06 2022] GET /identity/v3/groups/57dd9a229f754fe0ba34ef400b3062cc => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:06.434256 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7963daf-4112-4721-95ad-0713679dbf09 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:06.449782 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:06.520457 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d06bb-6ded-4d34-8644-851757683d43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:06.522151 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d06bb-6ded-4d34-8644-851757683d43 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:06.606228 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7963daf-4112-4721-95ad-0713679dbf09 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:06.667084 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0eccc-991e-4cc6-876d-0fe23dd16343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:06.668234 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0eccc-991e-4cc6-876d-0fe23dd16343 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:06.668683 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0eccc-991e-4cc6-876d-0fe23dd16343 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:06.669180 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0eccc-991e-4cc6-876d-0fe23dd16343 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:06.670174 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0eccc-991e-4cc6-876d-0fe23dd16343 None admin] RBAC: Adding query filter params (group.id=57dd9a229f754fe0ba34ef400b3062cc, role.id=64e752fa5df040c1a0b12914b5dacd49, scope.project.id=dd1ea6c1f8214651a9e7c21e90adac21) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:06.670708 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0eccc-991e-4cc6-876d-0fe23dd16343 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:06.672207 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0eccc-991e-4cc6-876d-0fe23dd16343 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:06.679848 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 173/354] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Aug 26 00:39:06 2022] GET /identity/v3/role_assignments?group.id=57dd9a229f754fe0ba34ef400b3062cc&scope.project.id=dd1ea6c1f8214651a9e7c21e90adac21&role.id=64e752fa5df040c1a0b12914b5dacd49 => generated 260 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:39:06.680831 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0eccc-991e-4cc6-876d-0fe23dd16343 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:06.692100 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 182/355] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:39:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:39:06.693448 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7402b3a-8ab9-4307-aabd-ee59f6bf3f74 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:06.693739 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7402b3a-8ab9-4307-aabd-ee59f6bf3f74 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:06.694081 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7402b3a-8ab9-4307-aabd-ee59f6bf3f74 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:06.695388 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 183/356] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:06.702066 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7402b3a-8ab9-4307-aabd-ee59f6bf3f74 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:06.738090 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:06.809189 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:06.876385 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0eccc-991e-4cc6-876d-0fe23dd16343 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:06.915687 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7402b3a-8ab9-4307-aabd-ee59f6bf3f74 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:06.954202 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932589e-6a11-480c-91ca-57ab47d9c5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:06.955715 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932589e-6a11-480c-91ca-57ab47d9c5dc None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:06.957478 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932589e-6a11-480c-91ca-57ab47d9c5dc None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:06.958020 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932589e-6a11-480c-91ca-57ab47d9c5dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:06.965623 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45233ee2-aa42-4767-8f9f-53194b8bf02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:06.966366 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45233ee2-aa42-4767-8f9f-53194b8bf02d None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:06.966657 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45233ee2-aa42-4767-8f9f-53194b8bf02d None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:06.967021 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45233ee2-aa42-4767-8f9f-53194b8bf02d None admin] PATH_INFO: `/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:06.968525 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45233ee2-aa42-4767-8f9f-53194b8bf02d None admin] RBAC: Authorizing `identity:get_project(project_id=dd1ea6c1f8214651a9e7c21e90adac21)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:06.970074 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45233ee2-aa42-4767-8f9f-53194b8bf02d None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:06.972476 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 184/357] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:39:06 2022] GET /identity/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21 => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:06.973924 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79899a07-f652-4eea-bb5d-f278a25c8d0d None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:06.974106 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79899a07-f652-4eea-bb5d-f278a25c8d0d None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:06.974366 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79899a07-f652-4eea-bb5d-f278a25c8d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:06.988933 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932589e-6a11-480c-91ca-57ab47d9c5dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:39:06.999557 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-79899a07-f652-4eea-bb5d-f278a25c8d0d None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:07.000772 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-0932589e-6a11-480c-91ca-57ab47d9c5dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:39:07.000772 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:07.000772 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:07.000772 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:07.000772 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:07.000772 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:07.000772 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:07.000772 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:07.000772 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:07.000772 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:07.000772 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:07.000772 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:07.000772 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:39:07.000772 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:39:07.000772 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:39:07.000772 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:39:07.001662 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:39:07.001662 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:39:07.001662 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:39:07.001662 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:39:07.001662 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:07.001662 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:07.001662 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:07.001662 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:07.001662 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:07.001662 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:07.001662 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:07.001662 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:07.001662 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:07.001662 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:07.001662 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:07.001662 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:07.002464 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:07.002464 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:07.002464 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:07.002464 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:07.002464 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:39:07.002464 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:39:07.002464 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:39:07.002464 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:39:07.002464 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:39:07.002464 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:39:07.002464 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:39:07.002464 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:07.003885 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-79899a07-f652-4eea-bb5d-f278a25c8d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:07.004030 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 174/358] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:39:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:07.005465 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932589e-6a11-480c-91ca-57ab47d9c5dc None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:07.087139 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 185/359] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:39:07.103963 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79899a07-f652-4eea-bb5d-f278a25c8d0d None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:07.137413 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:07.152783 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932589e-6a11-480c-91ca-57ab47d9c5dc None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:07.223647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f3d5f-6426-4f1b-9e80-ebfe0a53c694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:07.223647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f3d5f-6426-4f1b-9e80-ebfe0a53c694 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:07.223647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f3d5f-6426-4f1b-9e80-ebfe0a53c694 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:07.223647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f3d5f-6426-4f1b-9e80-ebfe0a53c694 None admin] PATH_INFO: `/v3/groups/57dd9a229f754fe0ba34ef400b3062cc` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:07.224818 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f3d5f-6426-4f1b-9e80-ebfe0a53c694 None admin] RBAC: Authorizing `identity:get_group(group_id=57dd9a229f754fe0ba34ef400b3062cc)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:07.226399 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f3d5f-6426-4f1b-9e80-ebfe0a53c694 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:07.229713 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 175/360] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 26 00:39:07 2022] GET /identity/v3/groups/57dd9a229f754fe0ba34ef400b3062cc => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:07.236369 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f3d5f-6426-4f1b-9e80-ebfe0a53c694 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:07.275922 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:07.369396 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f3d5f-6426-4f1b-9e80-ebfe0a53c694 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:07.400377 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79899a07-f652-4eea-bb5d-f278a25c8d0d None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:07.417801 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dda24b-60b0-432e-abb2-1b17c5f61560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:07.418457 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dda24b-60b0-432e-abb2-1b17c5f61560 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:07.418748 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dda24b-60b0-432e-abb2-1b17c5f61560 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:07.419027 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dda24b-60b0-432e-abb2-1b17c5f61560 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:07.419777 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dda24b-60b0-432e-abb2-1b17c5f61560 None admin] RBAC: Adding query filter params (group.id=57dd9a229f754fe0ba34ef400b3062cc, role.id=f0a369eda5014bb78b2d752c9abef48f, scope.project.id=dd1ea6c1f8214651a9e7c21e90adac21) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:07.420098 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dda24b-60b0-432e-abb2-1b17c5f61560 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:07.421890 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dda24b-60b0-432e-abb2-1b17c5f61560 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:07.437847 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 176/361] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Aug 26 00:39:07 2022] GET /identity/v3/role_assignments?group.id=57dd9a229f754fe0ba34ef400b3062cc&scope.project.id=dd1ea6c1f8214651a9e7c21e90adac21&role.id=f0a369eda5014bb78b2d752c9abef48f => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:07.439498 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61113fad-f1fd-4262-a450-1202c4729c07 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:07.439804 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61113fad-f1fd-4262-a450-1202c4729c07 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:07.440173 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61113fad-f1fd-4262-a450-1202c4729c07 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:07.443676 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 177/362] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:07.451337 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54f94a-c84d-431f-a96c-0308bae74fac None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:07.451675 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54f94a-c84d-431f-a96c-0308bae74fac None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:07.451905 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54f94a-c84d-431f-a96c-0308bae74fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:07.457976 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafe6a7-5beb-468e-9186-9e51573bd9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:07.458763 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafe6a7-5beb-468e-9186-9e51573bd9c0 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:07.459042 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafe6a7-5beb-468e-9186-9e51573bd9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:07.459403 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafe6a7-5beb-468e-9186-9e51573bd9c0 None admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:07.460102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafe6a7-5beb-468e-9186-9e51573bd9c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:07.460423 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafe6a7-5beb-468e-9186-9e51573bd9c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:07.461898 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafe6a7-5beb-468e-9186-9e51573bd9c0 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:07.483575 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-aa54f94a-c84d-431f-a96c-0308bae74fac None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:07.484279 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 186/363] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 00:39:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:07.484952 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-aa54f94a-c84d-431f-a96c-0308bae74fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:07.491207 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafe6a7-5beb-468e-9186-9e51573bd9c0 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:07.522188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:07.609096 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 178/364] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:39:07.642355 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54f94a-c84d-431f-a96c-0308bae74fac None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:07.696536 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafe6a7-5beb-468e-9186-9e51573bd9c0 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:07.724271 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:07.755510 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb3ec1-5009-4dcf-b72a-051292ded211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:07.756458 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb3ec1-5009-4dcf-b72a-051292ded211 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:07.756890 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb3ec1-5009-4dcf-b72a-051292ded211 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:07.759489 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb3ec1-5009-4dcf-b72a-051292ded211 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:07.874219 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54f94a-c84d-431f-a96c-0308bae74fac None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:07.896045 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb3ec1-5009-4dcf-b72a-051292ded211 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:07.898699 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb3ec1-5009-4dcf-b72a-051292ded211 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:08.014424 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534e253-fdd0-4181-83f6-940972db0ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:08.015002 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534e253-fdd0-4181-83f6-940972db0ae1 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:08.015348 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534e253-fdd0-4181-83f6-940972db0ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:08.016103 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534e253-fdd0-4181-83f6-940972db0ae1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:08.056266 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534e253-fdd0-4181-83f6-940972db0ae1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:39:08.058335 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 187/365] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:39:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:39:08.079635 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-1534e253-fdd0-4181-83f6-940972db0ae1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:39:08.079635 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:08.079635 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:08.079635 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:08.079635 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:08.079635 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:08.079635 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:08.079635 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:08.079635 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:08.079635 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:08.079635 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:08.079635 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:08.079635 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:39:08.079635 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:39:08.079635 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:39:08.079635 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:39:08.080805 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:39:08.080805 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:39:08.080805 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:39:08.080805 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:39:08.080805 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:08.080805 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:08.080805 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:08.080805 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:08.080805 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:08.080805 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:08.080805 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:08.080805 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:08.080805 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:08.080805 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:08.080805 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:08.080805 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:08.081664 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:08.081664 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:08.081664 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:08.081664 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:08.081664 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:39:08.081664 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:39:08.081664 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:39:08.081664 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:39:08.081664 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:39:08.081664 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:39:08.081664 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:39:08.081664 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:08.081664 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 179/366] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 00:39:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 441 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:39:08.083374 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb3ec1-5009-4dcf-b72a-051292ded211 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:08.091584 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534e253-fdd0-4181-83f6-940972db0ae1 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:08.121563 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:08.121761 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:08.226230 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb3ec1-5009-4dcf-b72a-051292ded211 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:08.231639 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534e253-fdd0-4181-83f6-940972db0ae1 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:08.271044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d2fa5-23a6-4799-8bf9-57a324ca42d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:08.272021 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d2fa5-23a6-4799-8bf9-57a324ca42d3 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:08.272380 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d2fa5-23a6-4799-8bf9-57a324ca42d3 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:08.272755 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d2fa5-23a6-4799-8bf9-57a324ca42d3 None admin] PATH_INFO: `/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:08.274266 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d2fa5-23a6-4799-8bf9-57a324ca42d3 None admin] RBAC: Authorizing `identity:get_project(project_id=0cb207b03a6c4bee8b0f421096a2b4fc)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:08.277587 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d2fa5-23a6-4799-8bf9-57a324ca42d3 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:08.280314 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 188/367] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:39:08 2022] GET /identity/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:08.281240 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d2fa5-23a6-4799-8bf9-57a324ca42d3 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:08.294109 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30f200-45b3-49d4-a8d6-dbdd9873e2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:08.295012 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30f200-45b3-49d4-a8d6-dbdd9873e2b3 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:08.295764 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30f200-45b3-49d4-a8d6-dbdd9873e2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:08.296444 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30f200-45b3-49d4-a8d6-dbdd9873e2b3 None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:08.299013 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30f200-45b3-49d4-a8d6-dbdd9873e2b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:08.299960 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30f200-45b3-49d4-a8d6-dbdd9873e2b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:08.302861 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30f200-45b3-49d4-a8d6-dbdd9873e2b3 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:08.313825 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 180/368] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:39:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:39:08.315556 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30f200-45b3-49d4-a8d6-dbdd9873e2b3 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:08.416853 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:08.429855 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:08.434481 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d2fa5-23a6-4799-8bf9-57a324ca42d3 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:08.466463 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30f200-45b3-49d4-a8d6-dbdd9873e2b3 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:08.493309 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02306e82-f621-4e9a-9fec-fd71faec852e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:08.494167 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02306e82-f621-4e9a-9fec-fd71faec852e None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:08.495256 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02306e82-f621-4e9a-9fec-fd71faec852e None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:08.495740 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02306e82-f621-4e9a-9fec-fd71faec852e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:08.512721 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02306e82-f621-4e9a-9fec-fd71faec852e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:39:08.519950 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca61e76-bd2b-4dc6-84f7-5f26072bf41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:08.520771 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca61e76-bd2b-4dc6-84f7-5f26072bf41b None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:08.521218 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca61e76-bd2b-4dc6-84f7-5f26072bf41b None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:08.521588 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca61e76-bd2b-4dc6-84f7-5f26072bf41b None admin] PATH_INFO: `/v3/groups/57dd9a229f754fe0ba34ef400b3062cc` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:08.521754 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-02306e82-f621-4e9a-9fec-fd71faec852e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:39:08.521754 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:08.521754 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:08.521754 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:08.521754 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:08.521754 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:08.521754 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:08.521754 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:08.521754 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:08.521754 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:08.521754 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:08.521754 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:08.521754 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:39:08.521754 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:39:08.521754 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:39:08.521754 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:39:08.522621 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:39:08.522621 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:39:08.522621 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:39:08.522621 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:39:08.522621 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:08.522621 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:08.522621 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:08.522621 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:08.522621 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:08.522621 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:08.522621 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:08.522621 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:08.522621 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:08.522621 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:08.522621 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:08.522621 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:08.523436 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:08.523436 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:08.523436 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:08.523436 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:08.523436 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:39:08.523436 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:39:08.523436 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:39:08.523436 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:39:08.523436 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:39:08.523436 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:39:08.523436 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:39:08.523436 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:08.524054 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca61e76-bd2b-4dc6-84f7-5f26072bf41b None admin] RBAC: Authorizing `identity:get_group(group_id=57dd9a229f754fe0ba34ef400b3062cc)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:08.524128 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 189/369] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 00:39:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:08.525415 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02306e82-f621-4e9a-9fec-fd71faec852e None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:08.526243 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca61e76-bd2b-4dc6-84f7-5f26072bf41b None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:08.528269 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 181/370] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 26 00:39:08 2022] GET /identity/v3/groups/57dd9a229f754fe0ba34ef400b3062cc => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:08.535872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca61e76-bd2b-4dc6-84f7-5f26072bf41b None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:08.699336 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca61e76-bd2b-4dc6-84f7-5f26072bf41b None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:08.710774 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02306e82-f621-4e9a-9fec-fd71faec852e None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:08.751790 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc62df-d25b-4010-940c-125cb5e3b10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:08.752477 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc62df-d25b-4010-940c-125cb5e3b10c None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:08.752767 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc62df-d25b-4010-940c-125cb5e3b10c None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:08.753239 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc62df-d25b-4010-940c-125cb5e3b10c None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:08.753986 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc62df-d25b-4010-940c-125cb5e3b10c None admin] RBAC: Adding query filter params (name=admin) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:08.754416 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc62df-d25b-4010-940c-125cb5e3b10c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:08.756274 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc62df-d25b-4010-940c-125cb5e3b10c None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:08.758697 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cca797-77dc-4955-93f0-19196e1616e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:08.760875 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cca797-77dc-4955-93f0-19196e1616e0 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:08.761355 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cca797-77dc-4955-93f0-19196e1616e0 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:08.761850 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cca797-77dc-4955-93f0-19196e1616e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:08.769256 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 182/371] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:39:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:08.770186 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc62df-d25b-4010-940c-125cb5e3b10c None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:08.783476 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:08.790626 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:08.869181 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cca797-77dc-4955-93f0-19196e1616e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:08.871957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cca797-77dc-4955-93f0-19196e1616e0 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:08.930050 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc62df-d25b-4010-940c-125cb5e3b10c None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:08.992242 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d4cfa-a783-4bd8-a907-2ffd7ed4a37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:08.995484 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d4cfa-a783-4bd8-a907-2ffd7ed4a37c None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:08.996096 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d4cfa-a783-4bd8-a907-2ffd7ed4a37c None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:08.996576 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d4cfa-a783-4bd8-a907-2ffd7ed4a37c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:08.997694 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d4cfa-a783-4bd8-a907-2ffd7ed4a37c None admin] RBAC: Adding query filter params (group.id=57dd9a229f754fe0ba34ef400b3062cc, role.id=64e752fa5df040c1a0b12914b5dacd49, scope.project.id=0cb207b03a6c4bee8b0f421096a2b4fc) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:08.998237 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d4cfa-a783-4bd8-a907-2ffd7ed4a37c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:08.999928 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d4cfa-a783-4bd8-a907-2ffd7ed4a37c None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:09.008033 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 183/372] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Aug 26 00:39:08 2022] GET /identity/v3/role_assignments?group.id=57dd9a229f754fe0ba34ef400b3062cc&scope.project.id=0cb207b03a6c4bee8b0f421096a2b4fc&role.id=64e752fa5df040c1a0b12914b5dacd49 => generated 260 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:09.010779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 190/373] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:39:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:39:09.012927 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cca797-77dc-4955-93f0-19196e1616e0 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:09.016312 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d4cfa-a783-4bd8-a907-2ffd7ed4a37c None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:09.074327 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:09.148186 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cca797-77dc-4955-93f0-19196e1616e0 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:09.195779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779e667-a9ac-4100-b9f5-e2043f61ba4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:09.197006 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779e667-a9ac-4100-b9f5-e2043f61ba4f None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:09.197585 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779e667-a9ac-4100-b9f5-e2043f61ba4f None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:09.198626 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779e667-a9ac-4100-b9f5-e2043f61ba4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:09.232768 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:09.305812 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779e667-a9ac-4100-b9f5-e2043f61ba4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:09.310087 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779e667-a9ac-4100-b9f5-e2043f61ba4f None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:09.319789 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d4cfa-a783-4bd8-a907-2ffd7ed4a37c None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:09.372422 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:09.409846 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1412474-149f-4856-92c8-51e06284b2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:09.410497 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1412474-149f-4856-92c8-51e06284b2d1 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:09.410780 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1412474-149f-4856-92c8-51e06284b2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:09.411060 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1412474-149f-4856-92c8-51e06284b2d1 None admin] PATH_INFO: `/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:09.412245 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1412474-149f-4856-92c8-51e06284b2d1 None admin] RBAC: Authorizing `identity:get_project(project_id=0cb207b03a6c4bee8b0f421096a2b4fc)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:09.422045 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1412474-149f-4856-92c8-51e06284b2d1 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:09.424397 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 184/374] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:39:09 2022] GET /identity/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc => generated 302 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:39:09.430475 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1412474-149f-4856-92c8-51e06284b2d1 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:09.476683 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 191/375] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:39:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:39:09.484060 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779e667-a9ac-4100-b9f5-e2043f61ba4f None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:09.608089 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1412474-149f-4856-92c8-51e06284b2d1 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:09.662575 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779e667-a9ac-4100-b9f5-e2043f61ba4f None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:09.690029 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31bcba-9afc-4687-8d62-86208c5110fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:09.690883 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31bcba-9afc-4687-8d62-86208c5110fe None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:09.691061 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31bcba-9afc-4687-8d62-86208c5110fe None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:09.691307 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31bcba-9afc-4687-8d62-86208c5110fe None admin] PATH_INFO: `/v3/groups/57dd9a229f754fe0ba34ef400b3062cc` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:09.692611 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31bcba-9afc-4687-8d62-86208c5110fe None admin] RBAC: Authorizing `identity:get_group(group_id=57dd9a229f754fe0ba34ef400b3062cc)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:09.694119 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31bcba-9afc-4687-8d62-86208c5110fe None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:09.696148 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 185/376] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 26 00:39:09 2022] GET /identity/v3/groups/57dd9a229f754fe0ba34ef400b3062cc => generated 226 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:09.703485 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31bcba-9afc-4687-8d62-86208c5110fe None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:09.726160 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:09.751117 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdfb6e-8613-47d9-b0a2-9c9975c5c280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:09.751767 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdfb6e-8613-47d9-b0a2-9c9975c5c280 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:09.752047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdfb6e-8613-47d9-b0a2-9c9975c5c280 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:09.752375 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdfb6e-8613-47d9-b0a2-9c9975c5c280 None admin] PATH_INFO: `/v3/projects/d490d60fce834824a5c1595cbd7a1ebe` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:09.755097 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fdfb6e-8613-47d9-b0a2-9c9975c5c280 None admin] RBAC: Authorizing `identity:get_project(project_id=d490d60fce834824a5c1595cbd7a1ebe)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:09.756597 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fdfb6e-8613-47d9-b0a2-9c9975c5c280 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:09.758610 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 192/377] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:39:09 2022] GET /identity/v3/projects/d490d60fce834824a5c1595cbd7a1ebe => generated 344 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:09.760299 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd30fb3-2d70-4efb-a012-c2c38969fc0e None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:09.761341 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd30fb3-2d70-4efb-a012-c2c38969fc0e None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:09.761695 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd30fb3-2d70-4efb-a012-c2c38969fc0e None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:09.763533 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 193/378] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:09.772916 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229be7e-ebb6-4916-9a16-317d65789012 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:09.773329 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229be7e-ebb6-4916-9a16-317d65789012 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:09.773530 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229be7e-ebb6-4916-9a16-317d65789012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:09.802532 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-2229be7e-ebb6-4916-9a16-317d65789012 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:09.804488 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-2229be7e-ebb6-4916-9a16-317d65789012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:09.816835 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:09.883927 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31bcba-9afc-4687-8d62-86208c5110fe None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:09.893708 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 194/379] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:39:09.894767 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229be7e-ebb6-4916-9a16-317d65789012 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:09.945809 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d86ebe-f31c-457c-9521-cf007f1023a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:09.946886 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d86ebe-f31c-457c-9521-cf007f1023a9 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:09.946886 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d86ebe-f31c-457c-9521-cf007f1023a9 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:09.947033 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d86ebe-f31c-457c-9521-cf007f1023a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:09.948415 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d86ebe-f31c-457c-9521-cf007f1023a9 None admin] RBAC: Adding query filter params (group.id=57dd9a229f754fe0ba34ef400b3062cc, role.id=f0a369eda5014bb78b2d752c9abef48f, scope.project.id=0cb207b03a6c4bee8b0f421096a2b4fc) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:09.948785 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d86ebe-f31c-457c-9521-cf007f1023a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:09.950474 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d86ebe-f31c-457c-9521-cf007f1023a9 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:09.958512 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 186/380] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Aug 26 00:39:09 2022] GET /identity/v3/role_assignments?group.id=57dd9a229f754fe0ba34ef400b3062cc&scope.project.id=0cb207b03a6c4bee8b0f421096a2b4fc&role.id=f0a369eda5014bb78b2d752c9abef48f => generated 260 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:10.071700 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229be7e-ebb6-4916-9a16-317d65789012 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:10.123578 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb6bab-c8f4-4843-830e-d5f5b35fb3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:10.124220 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb6bab-c8f4-4843-830e-d5f5b35fb3ba None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:10.124560 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb6bab-c8f4-4843-830e-d5f5b35fb3ba None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:10.124842 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb6bab-c8f4-4843-830e-d5f5b35fb3ba None admin] PATH_INFO: `/v3/groups/b3774956b1f343f394b941f682148cfb` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:10.139421 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb6bab-c8f4-4843-830e-d5f5b35fb3ba None admin] RBAC: Authorizing `identity:get_group(group_id=b3774956b1f343f394b941f682148cfb)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:10.140911 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb6bab-c8f4-4843-830e-d5f5b35fb3ba None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:10.143177 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 195/381] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 26 00:39:09 2022] GET /identity/v3/groups/b3774956b1f343f394b941f682148cfb => generated 229 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:10.148669 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d86ebe-f31c-457c-9521-cf007f1023a9 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:10.234380 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:10.269419 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d86ebe-f31c-457c-9521-cf007f1023a9 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:10.308144 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69aaf8-bff3-43c9-bdd4-5a9b26d059ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:10.308766 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69aaf8-bff3-43c9-bdd4-5a9b26d059ba None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:10.309051 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69aaf8-bff3-43c9-bdd4-5a9b26d059ba None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:10.309333 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69aaf8-bff3-43c9-bdd4-5a9b26d059ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:10.310110 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69aaf8-bff3-43c9-bdd4-5a9b26d059ba None admin] RBAC: Adding query filter params (group.id=b3774956b1f343f394b941f682148cfb, role.id=f13055bcebf847bf8b46160ded13810b, scope.project.id=d490d60fce834824a5c1595cbd7a1ebe) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:10.310429 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69aaf8-bff3-43c9-bdd4-5a9b26d059ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:10.312014 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69aaf8-bff3-43c9-bdd4-5a9b26d059ba None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:10.318548 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 187/382] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Aug 26 00:39:10 2022] GET /identity/v3/role_assignments?group.id=b3774956b1f343f394b941f682148cfb&scope.project.id=d490d60fce834824a5c1595cbd7a1ebe&role.id=f13055bcebf847bf8b46160ded13810b => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:10.463976 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb6bab-c8f4-4843-830e-d5f5b35fb3ba None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:10.474553 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:10.619172 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb6bab-c8f4-4843-830e-d5f5b35fb3ba None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:10.670378 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fda8ad-9d9e-4ca0-9725-a1637d44d513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:10.671044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fda8ad-9d9e-4ca0-9725-a1637d44d513 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:10.671329 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fda8ad-9d9e-4ca0-9725-a1637d44d513 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:10.671605 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fda8ad-9d9e-4ca0-9725-a1637d44d513 None admin] PATH_INFO: `/v3/roles/member` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:10.687013 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fda8ad-9d9e-4ca0-9725-a1637d44d513 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:39:10.692662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-e4fda8ad-9d9e-4ca0-9725-a1637d44d513 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:39:10.692662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:10.692662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:10.692662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:10.692662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:10.692662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:10.692662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:10.692662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:10.692662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:10.692662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:10.692662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:10.692662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:10.692662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:39:10.692662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:39:10.692662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:39:10.692662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:39:10.693658 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:39:10.693658 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:39:10.693658 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:39:10.693658 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:39:10.693658 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:10.693658 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:10.693658 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:10.693658 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:10.693658 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:10.693658 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:10.693658 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:10.693658 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:10.693658 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:10.693658 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:10.693658 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:10.693658 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:10.694459 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:10.694459 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:10.694459 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:10.694459 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:10.694459 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:39:10.694459 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:39:10.694459 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:39:10.694459 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:39:10.694459 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:39:10.694459 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:39:10.694459 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:39:10.694459 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:10.695952 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 196/383] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:39:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:10.703809 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69aaf8-bff3-43c9-bdd4-5a9b26d059ba None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:10.711059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfa5cd-0e2c-4931-a782-19b9979aea1b None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:10.711376 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfa5cd-0e2c-4931-a782-19b9979aea1b None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:10.711619 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfa5cd-0e2c-4931-a782-19b9979aea1b None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:10.714913 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 197/384] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:10.726439 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b22453-f599-4561-a68f-6bc904acee38 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:10.726777 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b22453-f599-4561-a68f-6bc904acee38 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:10.727060 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b22453-f599-4561-a68f-6bc904acee38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:10.762247 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-49b22453-f599-4561-a68f-6bc904acee38 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:10.764251 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-49b22453-f599-4561-a68f-6bc904acee38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:10.913336 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:10.922435 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 198/385] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:39:10.980396 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69aaf8-bff3-43c9-bdd4-5a9b26d059ba None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:11.048024 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac545735-3efa-4652-a670-1c403f8a14db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:11.048658 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac545735-3efa-4652-a670-1c403f8a14db None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:11.048948 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac545735-3efa-4652-a670-1c403f8a14db None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:11.049224 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac545735-3efa-4652-a670-1c403f8a14db None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:11.049944 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac545735-3efa-4652-a670-1c403f8a14db None admin] RBAC: Adding query filter params (name=member) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:11.050516 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac545735-3efa-4652-a670-1c403f8a14db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:11.051949 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac545735-3efa-4652-a670-1c403f8a14db None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:11.053952 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:11.066908 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 188/386] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 00:39:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:11.073356 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b22453-f599-4561-a68f-6bc904acee38 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:11.217816 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b22453-f599-4561-a68f-6bc904acee38 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:11.285942 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf85c7-824a-4eb4-b9a3-d23a0025712a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:11.287485 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf85c7-824a-4eb4-b9a3-d23a0025712a None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:11.288240 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf85c7-824a-4eb4-b9a3-d23a0025712a None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:11.288994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf85c7-824a-4eb4-b9a3-d23a0025712a None admin] PATH_INFO: `/v3/groups/57dd9a229f754fe0ba34ef400b3062cc` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:11.293842 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf85c7-824a-4eb4-b9a3-d23a0025712a None admin] RBAC: Authorizing `identity:get_group(group_id=57dd9a229f754fe0ba34ef400b3062cc)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:11.297194 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf85c7-824a-4eb4-b9a3-d23a0025712a None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:11.301237 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 199/387] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 26 00:39:11 2022] GET /identity/v3/groups/57dd9a229f754fe0ba34ef400b3062cc => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:11.309403 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac545735-3efa-4652-a670-1c403f8a14db None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:11.371262 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf85c7-824a-4eb4-b9a3-d23a0025712a None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:11.461719 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:11.516682 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf85c7-824a-4eb4-b9a3-d23a0025712a None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:11.559705 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac545735-3efa-4652-a670-1c403f8a14db None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:11.567717 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3955fbf-b166-4182-98fc-c8a4e4362b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:11.568819 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3955fbf-b166-4182-98fc-c8a4e4362b87 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:11.569285 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3955fbf-b166-4182-98fc-c8a4e4362b87 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:11.569821 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3955fbf-b166-4182-98fc-c8a4e4362b87 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:11.585080 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3955fbf-b166-4182-98fc-c8a4e4362b87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:39:11.591779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-f3955fbf-b166-4182-98fc-c8a4e4362b87 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:39:11.591779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:11.591779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:11.591779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:11.591779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:11.591779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:11.591779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:11.591779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:11.591779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:11.591779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:11.591779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:11.591779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:11.591779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:39:11.591779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:39:11.591779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:39:11.591779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:39:11.592828 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:39:11.592828 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:39:11.592828 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:39:11.592828 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:39:11.592828 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:11.592828 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:11.592828 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:11.592828 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:11.592828 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:11.592828 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:11.592828 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:11.592828 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:11.592828 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:11.592828 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:11.592828 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:11.592828 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:11.593668 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:11.593668 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:11.593668 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:11.593668 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:11.593668 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:39:11.593668 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:39:11.593668 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:39:11.593668 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:39:11.593668 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:39:11.593668 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:39:11.593668 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:39:11.593668 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:11.597667 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 200/388] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 00:39:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:39:11.605651 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3955fbf-b166-4182-98fc-c8a4e4362b87 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:11.634504 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699a1be-031d-42fe-990c-7dc4e7fd1be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:11.635918 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699a1be-031d-42fe-990c-7dc4e7fd1be0 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:11.636111 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699a1be-031d-42fe-990c-7dc4e7fd1be0 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:11.636277 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699a1be-031d-42fe-990c-7dc4e7fd1be0 None admin] PATH_INFO: `/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:11.638171 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699a1be-031d-42fe-990c-7dc4e7fd1be0 None admin] RBAC: Authorizing `identity:get_project(project_id=dd1ea6c1f8214651a9e7c21e90adac21)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:11.639650 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699a1be-031d-42fe-990c-7dc4e7fd1be0 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:11.642631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 189/389] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:39:11 2022] GET /identity/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21 => generated 298 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:11.649147 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699a1be-031d-42fe-990c-7dc4e7fd1be0 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:11.792371 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:11.836282 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3955fbf-b166-4182-98fc-c8a4e4362b87 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:11.876839 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699a1be-031d-42fe-990c-7dc4e7fd1be0 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:11.890620 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:11.922700 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269b4a7-179a-48b5-8e3e-2099a74b31b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:11.923328 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269b4a7-179a-48b5-8e3e-2099a74b31b0 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:11.923778 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269b4a7-179a-48b5-8e3e-2099a74b31b0 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:11.924064 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269b4a7-179a-48b5-8e3e-2099a74b31b0 None admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:11.924779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a269b4a7-179a-48b5-8e3e-2099a74b31b0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:11.925398 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a269b4a7-179a-48b5-8e3e-2099a74b31b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:11.926830 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a269b4a7-179a-48b5-8e3e-2099a74b31b0 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:11.952501 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 201/390] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:39:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:11.960520 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269b4a7-179a-48b5-8e3e-2099a74b31b0 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:11.974127 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a88aa0-ef0e-465c-a9ff-428a36c4eab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:11.974845 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a88aa0-ef0e-465c-a9ff-428a36c4eab9 None admin] REQUEST_METHOD: `PUT` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:11.975193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a88aa0-ef0e-465c-a9ff-428a36c4eab9 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:11.975475 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a88aa0-ef0e-465c-a9ff-428a36c4eab9 None admin] PATH_INFO: `/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21/groups/57dd9a229f754fe0ba34ef400b3062cc/roles/64e752fa5df040c1a0b12914b5dacd49` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:11.983280 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a88aa0-ef0e-465c-a9ff-428a36c4eab9 None admin] RBAC: Authorizing `identity:create_grant(project_id=dd1ea6c1f8214651a9e7c21e90adac21, group_id=57dd9a229f754fe0ba34ef400b3062cc, role_id=64e752fa5df040c1a0b12914b5dacd49)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:11.984829 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a88aa0-ef0e-465c-a9ff-428a36c4eab9 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:12.076359 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 190/391] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Aug 26 00:39:11 2022] PUT /identity/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21/groups/57dd9a229f754fe0ba34ef400b3062cc/roles/64e752fa5df040c1a0b12914b5dacd49 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:12.109953 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269b4a7-179a-48b5-8e3e-2099a74b31b0 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:12.175467 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be36ef0-20ed-456b-9a80-5d4001c9fd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:12.176564 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be36ef0-20ed-456b-9a80-5d4001c9fd88 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:12.177055 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be36ef0-20ed-456b-9a80-5d4001c9fd88 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:12.177591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be36ef0-20ed-456b-9a80-5d4001c9fd88 None admin] PATH_INFO: `/v3/groups/57dd9a229f754fe0ba34ef400b3062cc` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:12.182839 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be36ef0-20ed-456b-9a80-5d4001c9fd88 None admin] RBAC: Authorizing `identity:get_group(group_id=57dd9a229f754fe0ba34ef400b3062cc)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:12.185789 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be36ef0-20ed-456b-9a80-5d4001c9fd88 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:12.188283 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 202/392] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 26 00:39:11 2022] GET /identity/v3/groups/57dd9a229f754fe0ba34ef400b3062cc => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:39:12.193892 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a88aa0-ef0e-465c-a9ff-428a36c4eab9 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:12.329779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23b490-69d6-4036-a7da-44c057b7f66b None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:12.330281 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23b490-69d6-4036-a7da-44c057b7f66b None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:12.330281 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23b490-69d6-4036-a7da-44c057b7f66b None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:12.331937 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 203/393] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:12.337586 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59f20d-2314-4bf2-a507-ae63e29c97ae None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:12.337926 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59f20d-2314-4bf2-a507-ae63e29c97ae None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:12.338144 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59f20d-2314-4bf2-a507-ae63e29c97ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:12.364786 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a88aa0-ef0e-465c-a9ff-428a36c4eab9 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:12.386939 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-8f59f20d-2314-4bf2-a507-ae63e29c97ae None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:12.388255 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-8f59f20d-2314-4bf2-a507-ae63e29c97ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:12.396930 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:12.417650 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2f1af-848c-4ad0-9863-ee0afc9852dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:12.418691 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2f1af-848c-4ad0-9863-ee0afc9852dd None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:12.419212 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2f1af-848c-4ad0-9863-ee0afc9852dd None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:12.419699 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2f1af-848c-4ad0-9863-ee0afc9852dd None admin] PATH_INFO: `/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:12.421212 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2f1af-848c-4ad0-9863-ee0afc9852dd None admin] RBAC: Authorizing `identity:get_project(project_id=dd1ea6c1f8214651a9e7c21e90adac21)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:12.422943 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2f1af-848c-4ad0-9863-ee0afc9852dd None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:12.425324 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 191/394] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:39:12 2022] GET /identity/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:12.434625 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2f1af-848c-4ad0-9863-ee0afc9852dd None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:12.472434 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:12.501598 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 204/395] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:39:12.581318 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2f1af-848c-4ad0-9863-ee0afc9852dd None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:12.624075 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb8c08-7016-4269-820f-24a802faa3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:12.624755 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb8c08-7016-4269-820f-24a802faa3f1 None admin] REQUEST_METHOD: `PUT` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:12.625035 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb8c08-7016-4269-820f-24a802faa3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:12.625309 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb8c08-7016-4269-820f-24a802faa3f1 None admin] PATH_INFO: `/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21/groups/57dd9a229f754fe0ba34ef400b3062cc/roles/f0a369eda5014bb78b2d752c9abef48f` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:12.627590 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb8c08-7016-4269-820f-24a802faa3f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=dd1ea6c1f8214651a9e7c21e90adac21, group_id=57dd9a229f754fe0ba34ef400b3062cc, role_id=f0a369eda5014bb78b2d752c9abef48f)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:12.629046 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb8c08-7016-4269-820f-24a802faa3f1 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:12.722174 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 192/396] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Aug 26 00:39:12 2022] PUT /identity/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21/groups/57dd9a229f754fe0ba34ef400b3062cc/roles/f0a369eda5014bb78b2d752c9abef48f => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:39:12.862122 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c910128-b575-4863-b189-950aa903c708 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:12.862468 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c910128-b575-4863-b189-950aa903c708 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:12.862666 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c910128-b575-4863-b189-950aa903c708 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:12.864428 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 205/397] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:12.879179 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd39b1-ee77-415b-bd66-f479a2dde011 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:12.879482 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd39b1-ee77-415b-bd66-f479a2dde011 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:12.879730 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd39b1-ee77-415b-bd66-f479a2dde011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:12.894592 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c910128-b575-4863-b189-950aa903c708 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:12.904969 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-bcdd39b1-ee77-415b-bd66-f479a2dde011 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:12.906224 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-bcdd39b1-ee77-415b-bd66-f479a2dde011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:12.993801 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:13.031989 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 193/398] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:39:13.082821 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c910128-b575-4863-b189-950aa903c708 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:13.135384 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42808e88-58ce-457e-bac9-3bfeaed8e783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:13.135925 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42808e88-58ce-457e-bac9-3bfeaed8e783 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:13.136208 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42808e88-58ce-457e-bac9-3bfeaed8e783 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:13.136484 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42808e88-58ce-457e-bac9-3bfeaed8e783 None admin] PATH_INFO: `/v3/roles/member` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:13.151285 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42808e88-58ce-457e-bac9-3bfeaed8e783 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:39:13.156313 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-42808e88-58ce-457e-bac9-3bfeaed8e783 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:39:13.156313 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:13.156313 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:13.156313 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:13.156313 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:13.156313 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:13.156313 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:13.156313 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:13.156313 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:13.156313 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:13.156313 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:13.156313 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:13.156313 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:39:13.156313 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:39:13.156313 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:39:13.156313 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:39:13.157288 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:39:13.157288 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:39:13.157288 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:39:13.157288 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:39:13.157288 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:13.157288 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:13.157288 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:13.157288 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:13.157288 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:13.157288 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:13.157288 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:13.157288 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:13.157288 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:13.157288 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:13.157288 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:13.157288 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:13.158115 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:13.158115 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:13.158115 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:13.158115 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:13.158115 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:39:13.158115 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:39:13.158115 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:39:13.158115 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:39:13.158115 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:39:13.158115 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:39:13.158115 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:39:13.158115 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:13.158115 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 206/399] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:39:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:13.163678 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd39b1-ee77-415b-bd66-f479a2dde011 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:13.288886 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd39b1-ee77-415b-bd66-f479a2dde011 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:13.327738 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368ec73-e628-476d-912d-526828a3c5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:13.328362 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368ec73-e628-476d-912d-526828a3c5fd None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:13.328643 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368ec73-e628-476d-912d-526828a3c5fd None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:13.328921 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368ec73-e628-476d-912d-526828a3c5fd None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:13.329623 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368ec73-e628-476d-912d-526828a3c5fd None admin] RBAC: Adding query filter params (name=member) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:13.330050 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368ec73-e628-476d-912d-526828a3c5fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:13.331441 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368ec73-e628-476d-912d-526828a3c5fd None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:13.341626 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 194/400] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 00:39:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:39:13.348431 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42808e88-58ce-457e-bac9-3bfeaed8e783 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:13.407245 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:13.485941 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42808e88-58ce-457e-bac9-3bfeaed8e783 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:13.527631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368ec73-e628-476d-912d-526828a3c5fd None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:13.540762 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ffb62-fb3f-42aa-9ca9-6f401a8168af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:13.542590 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ffb62-fb3f-42aa-9ca9-6f401a8168af None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:13.543128 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ffb62-fb3f-42aa-9ca9-6f401a8168af None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:13.543676 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ffb62-fb3f-42aa-9ca9-6f401a8168af None admin] PATH_INFO: `/v3/groups/57dd9a229f754fe0ba34ef400b3062cc` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:13.547543 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ffb62-fb3f-42aa-9ca9-6f401a8168af None admin] RBAC: Authorizing `identity:get_group(group_id=57dd9a229f754fe0ba34ef400b3062cc)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:13.549247 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ffb62-fb3f-42aa-9ca9-6f401a8168af None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:13.551384 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 207/401] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 26 00:39:13 2022] GET /identity/v3/groups/57dd9a229f754fe0ba34ef400b3062cc => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:13.557660 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ffb62-fb3f-42aa-9ca9-6f401a8168af None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:13.599892 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:13.661965 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368ec73-e628-476d-912d-526828a3c5fd None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:13.712945 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85f001-4aae-4d7c-8049-f15a1a5af63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:13.714217 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85f001-4aae-4d7c-8049-f15a1a5af63c None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:13.714925 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85f001-4aae-4d7c-8049-f15a1a5af63c None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:13.715407 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85f001-4aae-4d7c-8049-f15a1a5af63c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:13.716675 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ffb62-fb3f-42aa-9ca9-6f401a8168af None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:13.729866 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85f001-4aae-4d7c-8049-f15a1a5af63c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:39:13.732014 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:13.738184 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-4d85f001-4aae-4d7c-8049-f15a1a5af63c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:39:13.738184 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:13.738184 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:13.738184 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:13.738184 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:13.738184 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:13.738184 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:13.738184 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:13.738184 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:13.738184 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:13.738184 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:13.738184 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:13.738184 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:39:13.738184 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:39:13.738184 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:39:13.738184 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:39:13.739286 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:39:13.739286 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:39:13.739286 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:39:13.739286 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:39:13.739286 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:13.739286 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:13.739286 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:13.739286 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:13.739286 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:13.739286 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:13.739286 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:13.739286 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:13.739286 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:13.739286 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:13.739286 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:13.739286 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:13.740312 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:13.740312 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:13.740312 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:13.740312 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:13.740312 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:39:13.740312 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:39:13.740312 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:39:13.740312 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:39:13.740312 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:39:13.740312 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:39:13.740312 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:39:13.740312 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:13.743196 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 195/402] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 00:39:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:13.746582 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8007b90-3353-4e9a-9949-66e40d63c79c None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:13.746582 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8007b90-3353-4e9a-9949-66e40d63c79c None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:13.746582 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8007b90-3353-4e9a-9949-66e40d63c79c None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:13.748138 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 196/403] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:13.751452 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8007b90-3353-4e9a-9949-66e40d63c79c None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:13.770516 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39c926-3678-48e1-9c75-d57dd0cf57f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:13.771422 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39c926-3678-48e1-9c75-d57dd0cf57f7 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:13.772174 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39c926-3678-48e1-9c75-d57dd0cf57f7 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:13.772700 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39c926-3678-48e1-9c75-d57dd0cf57f7 None admin] PATH_INFO: `/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:13.774936 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39c926-3678-48e1-9c75-d57dd0cf57f7 None admin] RBAC: Authorizing `identity:get_project(project_id=0cb207b03a6c4bee8b0f421096a2b4fc)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:13.777010 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39c926-3678-48e1-9c75-d57dd0cf57f7 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:13.779806 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 208/404] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:39:13 2022] GET /identity/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:39:13.781751 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a30bc-04d8-4a41-86aa-f5dc24bf8bb5 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:13.782495 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a30bc-04d8-4a41-86aa-f5dc24bf8bb5 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:13.782919 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a30bc-04d8-4a41-86aa-f5dc24bf8bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:13.806073 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-416a30bc-04d8-4a41-86aa-f5dc24bf8bb5 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:13.808855 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-416a30bc-04d8-4a41-86aa-f5dc24bf8bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:13.885653 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 209/405] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:39:13.886436 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a30bc-04d8-4a41-86aa-f5dc24bf8bb5 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:13.902156 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8007b90-3353-4e9a-9949-66e40d63c79c None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:13.906497 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:13.972157 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e3e39-bd1c-40dc-b1fa-8b7f43326926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:13.972786 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e3e39-bd1c-40dc-b1fa-8b7f43326926 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:13.973070 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e3e39-bd1c-40dc-b1fa-8b7f43326926 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:13.973350 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e3e39-bd1c-40dc-b1fa-8b7f43326926 None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:13.974052 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e3e39-bd1c-40dc-b1fa-8b7f43326926 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:13.974364 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e3e39-bd1c-40dc-b1fa-8b7f43326926 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:13.977691 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e3e39-bd1c-40dc-b1fa-8b7f43326926 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:13.993686 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 197/406] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:39:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:14.000828 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e3e39-bd1c-40dc-b1fa-8b7f43326926 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:14.086776 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a30bc-04d8-4a41-86aa-f5dc24bf8bb5 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:14.107105 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:14.151232 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b057c-07b3-4672-803d-c2f5b422773c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:14.152143 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b057c-07b3-4672-803d-c2f5b422773c None admin] REQUEST_METHOD: `PUT` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:14.152433 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b057c-07b3-4672-803d-c2f5b422773c None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:14.152709 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b057c-07b3-4672-803d-c2f5b422773c None admin] PATH_INFO: `/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc/groups/57dd9a229f754fe0ba34ef400b3062cc/roles/64e752fa5df040c1a0b12914b5dacd49` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:14.156351 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b057c-07b3-4672-803d-c2f5b422773c None admin] RBAC: Authorizing `identity:create_grant(project_id=0cb207b03a6c4bee8b0f421096a2b4fc, group_id=57dd9a229f754fe0ba34ef400b3062cc, role_id=64e752fa5df040c1a0b12914b5dacd49)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:14.157768 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b057c-07b3-4672-803d-c2f5b422773c None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:14.178084 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e3e39-bd1c-40dc-b1fa-8b7f43326926 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:14.214677 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d64101-8815-468f-b288-ba2ca504d30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:14.215302 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d64101-8815-468f-b288-ba2ca504d30e None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:14.215593 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d64101-8815-468f-b288-ba2ca504d30e None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:14.215870 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d64101-8815-468f-b288-ba2ca504d30e None admin] PATH_INFO: `/v3/groups/57dd9a229f754fe0ba34ef400b3062cc` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:14.217822 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d64101-8815-468f-b288-ba2ca504d30e None admin] RBAC: Authorizing `identity:get_group(group_id=57dd9a229f754fe0ba34ef400b3062cc)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:14.219593 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d64101-8815-468f-b288-ba2ca504d30e None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:14.221261 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 198/407] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 26 00:39:13 2022] GET /identity/v3/groups/57dd9a229f754fe0ba34ef400b3062cc => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:39:14.226952 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d64101-8815-468f-b288-ba2ca504d30e None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:14.248061 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 210/408] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Aug 26 00:39:13 2022] PUT /identity/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc/groups/57dd9a229f754fe0ba34ef400b3062cc/roles/64e752fa5df040c1a0b12914b5dacd49 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:14.272245 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b057c-07b3-4672-803d-c2f5b422773c None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:14.284511 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:14.368650 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d64101-8815-468f-b288-ba2ca504d30e None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:14.413432 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b24cd-b036-4003-987a-ecd09c6852a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:14.414448 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b24cd-b036-4003-987a-ecd09c6852a7 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:14.414956 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b24cd-b036-4003-987a-ecd09c6852a7 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:14.416291 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b24cd-b036-4003-987a-ecd09c6852a7 None admin] PATH_INFO: `/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:14.420744 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b24cd-b036-4003-987a-ecd09c6852a7 None admin] RBAC: Authorizing `identity:get_project(project_id=0cb207b03a6c4bee8b0f421096a2b4fc)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:14.422615 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b24cd-b036-4003-987a-ecd09c6852a7 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:14.426754 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 199/409] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:39:14 2022] GET /identity/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:39:14.433840 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b24cd-b036-4003-987a-ecd09c6852a7 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:14.502634 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b057c-07b3-4672-803d-c2f5b422773c None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:14.543760 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf3dae-97c1-4c96-bc57-f9ce4fa51975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:14.544942 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf3dae-97c1-4c96-bc57-f9ce4fa51975 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:14.545469 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf3dae-97c1-4c96-bc57-f9ce4fa51975 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:14.546343 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf3dae-97c1-4c96-bc57-f9ce4fa51975 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:14.570447 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf3dae-97c1-4c96-bc57-f9ce4fa51975 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:39:14.570828 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b24cd-b036-4003-987a-ecd09c6852a7 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:14.575057 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:14.578800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-a3cf3dae-97c1-4c96-bc57-f9ce4fa51975 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:39:14.578800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:14.578800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:14.578800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:14.578800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:14.578800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:14.578800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:14.578800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:14.578800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:14.578800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:14.578800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:14.578800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:14.578800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:39:14.578800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:39:14.578800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:39:14.578800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:39:14.579745 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:39:14.579745 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:39:14.579745 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:39:14.579745 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:39:14.579745 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:14.579745 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:14.579745 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:14.579745 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:14.579745 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:14.579745 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:14.579745 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:14.579745 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:14.579745 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:14.579745 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:14.579745 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:14.579745 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:14.580508 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:14.580508 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:14.580508 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:14.580508 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:14.580508 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:39:14.580508 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:39:14.580508 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:39:14.580508 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:39:14.580508 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:39:14.580508 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:39:14.580508 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:39:14.580508 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:14.580508 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 211/410] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 00:39:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:14.593639 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf3dae-97c1-4c96-bc57-f9ce4fa51975 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:14.634488 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e566b-b281-46de-88ed-b08367dae5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:14.635201 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e566b-b281-46de-88ed-b08367dae5f2 None admin] REQUEST_METHOD: `PUT` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:14.635483 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e566b-b281-46de-88ed-b08367dae5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:14.635767 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e566b-b281-46de-88ed-b08367dae5f2 None admin] PATH_INFO: `/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc/groups/57dd9a229f754fe0ba34ef400b3062cc/roles/f0a369eda5014bb78b2d752c9abef48f` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:14.640807 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e566b-b281-46de-88ed-b08367dae5f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=0cb207b03a6c4bee8b0f421096a2b4fc, group_id=57dd9a229f754fe0ba34ef400b3062cc, role_id=f0a369eda5014bb78b2d752c9abef48f)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:14.642331 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e566b-b281-46de-88ed-b08367dae5f2 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:14.652516 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:14.738296 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 200/411] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Aug 26 00:39:14 2022] PUT /identity/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc/groups/57dd9a229f754fe0ba34ef400b3062cc/roles/f0a369eda5014bb78b2d752c9abef48f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:39:14.743680 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf3dae-97c1-4c96-bc57-f9ce4fa51975 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:14.799548 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594eff9-02e9-4e40-8490-d1ee1f661a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:14.800358 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594eff9-02e9-4e40-8490-d1ee1f661a2e None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:14.800642 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594eff9-02e9-4e40-8490-d1ee1f661a2e None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:14.800922 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594eff9-02e9-4e40-8490-d1ee1f661a2e None admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:14.801730 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594eff9-02e9-4e40-8490-d1ee1f661a2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:14.802100 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594eff9-02e9-4e40-8490-d1ee1f661a2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:14.803629 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594eff9-02e9-4e40-8490-d1ee1f661a2e None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:14.817223 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 212/412] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:39:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:39:14.823312 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e566b-b281-46de-88ed-b08367dae5f2 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:14.963327 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e566b-b281-46de-88ed-b08367dae5f2 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:15.001781 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbca4a3-b1e9-4241-b426-d4a82f190c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:15.002772 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbca4a3-b1e9-4241-b426-d4a82f190c91 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:15.003268 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbca4a3-b1e9-4241-b426-d4a82f190c91 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:15.003753 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbca4a3-b1e9-4241-b426-d4a82f190c91 None admin] PATH_INFO: `/v3/groups/b3774956b1f343f394b941f682148cfb` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:15.005088 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbca4a3-b1e9-4241-b426-d4a82f190c91 None admin] RBAC: Authorizing `identity:get_group(group_id=b3774956b1f343f394b941f682148cfb)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:15.006763 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbca4a3-b1e9-4241-b426-d4a82f190c91 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:15.008829 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 201/413] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 26 00:39:14 2022] GET /identity/v3/groups/b3774956b1f343f394b941f682148cfb => generated 229 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:15.016970 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594eff9-02e9-4e40-8490-d1ee1f661a2e None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:15.157921 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:15.165270 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594eff9-02e9-4e40-8490-d1ee1f661a2e None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:15.212456 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e87ca8-aa31-4777-8f40-53cb965d2b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:15.213481 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e87ca8-aa31-4777-8f40-53cb965d2b3f None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:15.213790 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e87ca8-aa31-4777-8f40-53cb965d2b3f None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:15.214221 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e87ca8-aa31-4777-8f40-53cb965d2b3f None admin] PATH_INFO: `/v3/projects/d490d60fce834824a5c1595cbd7a1ebe` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:15.215408 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e87ca8-aa31-4777-8f40-53cb965d2b3f None admin] RBAC: Authorizing `identity:get_project(project_id=d490d60fce834824a5c1595cbd7a1ebe)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:15.216871 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e87ca8-aa31-4777-8f40-53cb965d2b3f None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:15.218860 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 213/414] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:39:15 2022] GET /identity/v3/projects/d490d60fce834824a5c1595cbd7a1ebe => generated 344 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:15.224862 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbca4a3-b1e9-4241-b426-d4a82f190c91 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:15.283182 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9b034-3c1a-4e6b-82f6-beb1e9851f1f None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:15.283696 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9b034-3c1a-4e6b-82f6-beb1e9851f1f None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:15.284138 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9b034-3c1a-4e6b-82f6-beb1e9851f1f None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:15.289860 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 214/415] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:39:15.291652 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74043b6b-ae3a-445d-a238-2570c1005b9d None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:15.292110 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74043b6b-ae3a-445d-a238-2570c1005b9d None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:15.292531 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74043b6b-ae3a-445d-a238-2570c1005b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:15.304983 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:15.327348 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-74043b6b-ae3a-445d-a238-2570c1005b9d None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:15.328557 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-74043b6b-ae3a-445d-a238-2570c1005b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:15.438334 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbca4a3-b1e9-4241-b426-d4a82f190c91 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:15.462921 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 215/416] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:39:15.489831 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86717bdd-a261-413b-a5a4-c225a713718d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:15.490523 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86717bdd-a261-413b-a5a4-c225a713718d None admin] REQUEST_METHOD: `PUT` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:15.490810 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86717bdd-a261-413b-a5a4-c225a713718d None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:15.491088 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86717bdd-a261-413b-a5a4-c225a713718d None admin] PATH_INFO: `/v3/projects/d490d60fce834824a5c1595cbd7a1ebe/groups/b3774956b1f343f394b941f682148cfb/roles/f13055bcebf847bf8b46160ded13810b` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:15.493079 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86717bdd-a261-413b-a5a4-c225a713718d None admin] RBAC: Authorizing `identity:create_grant(project_id=d490d60fce834824a5c1595cbd7a1ebe, group_id=b3774956b1f343f394b941f682148cfb, role_id=f13055bcebf847bf8b46160ded13810b)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:15.494666 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86717bdd-a261-413b-a5a4-c225a713718d None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:15.590409 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 202/417] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Aug 26 00:39:15 2022] PUT /identity/v3/projects/d490d60fce834824a5c1595cbd7a1ebe/groups/b3774956b1f343f394b941f682148cfb/roles/f13055bcebf847bf8b46160ded13810b => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:15.660220 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b784f-9883-4a52-b70e-b4193ca92933 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:15.660755 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b784f-9883-4a52-b70e-b4193ca92933 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:15.660755 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b784f-9883-4a52-b70e-b4193ca92933 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:15.662206 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 216/418] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:15.671888 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c14be-4fdf-44ae-aac3-5051e8e7518b None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:15.672192 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c14be-4fdf-44ae-aac3-5051e8e7518b None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:15.672464 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c14be-4fdf-44ae-aac3-5051e8e7518b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:15.699261 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-f14c14be-4fdf-44ae-aac3-5051e8e7518b None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:15.700421 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-f14c14be-4fdf-44ae-aac3-5051e8e7518b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:15.805464 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 203/419] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:39:15.831603 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b784f-9883-4a52-b70e-b4193ca92933 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:15.965231 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:15.971370 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b784f-9883-4a52-b70e-b4193ca92933 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:16.020483 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84f768-617e-49b3-b1e8-c17397fe6b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:16.021131 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84f768-617e-49b3-b1e8-c17397fe6b2b None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:16.021441 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84f768-617e-49b3-b1e8-c17397fe6b2b None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:16.021789 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84f768-617e-49b3-b1e8-c17397fe6b2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:16.033494 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84f768-617e-49b3-b1e8-c17397fe6b2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:39:16.038642 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-7a84f768-617e-49b3-b1e8-c17397fe6b2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:39:16.038642 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:16.038642 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:16.038642 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:16.038642 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:16.038642 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:16.038642 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:16.038642 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:16.038642 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:16.038642 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:16.038642 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:16.038642 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:16.038642 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:39:16.038642 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:39:16.038642 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:39:16.038642 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:39:16.039619 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:39:16.039619 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:39:16.039619 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:39:16.039619 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:39:16.039619 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:16.039619 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:16.039619 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:16.039619 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:16.039619 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:16.039619 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:16.039619 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:16.039619 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:16.039619 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:16.039619 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:16.039619 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:16.039619 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:16.040386 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:16.040386 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:16.040386 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:16.040386 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:16.040386 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:39:16.040386 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:39:16.040386 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:39:16.040386 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:39:16.040386 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:39:16.040386 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:39:16.040386 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:39:16.040386 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:16.040386 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 217/420] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:39:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:16.048171 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c14be-4fdf-44ae-aac3-5051e8e7518b None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:16.071392 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:16.156845 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c14be-4fdf-44ae-aac3-5051e8e7518b None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:16.192757 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463552fa-2959-4644-a2c2-bfa5e759b333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:16.193410 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463552fa-2959-4644-a2c2-bfa5e759b333 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:16.193708 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463552fa-2959-4644-a2c2-bfa5e759b333 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:16.193995 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463552fa-2959-4644-a2c2-bfa5e759b333 None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:16.194610 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84f768-617e-49b3-b1e8-c17397fe6b2b None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:16.194724 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463552fa-2959-4644-a2c2-bfa5e759b333 None admin] RBAC: Adding query filter params (name=member) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:16.194984 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463552fa-2959-4644-a2c2-bfa5e759b333 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:16.196376 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463552fa-2959-4644-a2c2-bfa5e759b333 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:16.218462 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 204/421] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 00:39:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:16.225402 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463552fa-2959-4644-a2c2-bfa5e759b333 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:16.392865 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84f768-617e-49b3-b1e8-c17397fe6b2b None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:16.400373 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:16.435045 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463552fa-2959-4644-a2c2-bfa5e759b333 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:16.450500 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206f60c-6e6c-4527-8090-4f47c7807168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:16.451169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206f60c-6e6c-4527-8090-4f47c7807168 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:16.451459 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206f60c-6e6c-4527-8090-4f47c7807168 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:16.451928 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206f60c-6e6c-4527-8090-4f47c7807168 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:16.476056 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206f60c-6e6c-4527-8090-4f47c7807168 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:39:16.488650 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-9206f60c-6e6c-4527-8090-4f47c7807168 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:39:16.488650 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:16.488650 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:16.488650 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:16.488650 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:16.488650 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:16.488650 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:16.488650 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:16.488650 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:16.488650 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:16.488650 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:16.488650 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:16.488650 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:39:16.488650 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:39:16.488650 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:39:16.488650 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:39:16.489596 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:39:16.489596 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:39:16.489596 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:39:16.489596 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:39:16.489596 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:16.489596 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:16.489596 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:16.489596 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:16.489596 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:16.489596 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:16.489596 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:16.489596 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:16.489596 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:16.489596 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:16.489596 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:16.489596 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:16.490370 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:16.490370 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:16.490370 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:16.490370 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:16.490370 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:39:16.490370 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:39:16.490370 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:39:16.490370 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:39:16.490370 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:39:16.490370 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:39:16.490370 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:39:16.490370 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:16.493141 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 218/422] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 00:39:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:39:16.499236 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206f60c-6e6c-4527-8090-4f47c7807168 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:16.509759 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dee7dc-1060-4e9c-a95b-1b04826c4fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:16.513396 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dee7dc-1060-4e9c-a95b-1b04826c4fa5 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:16.513396 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dee7dc-1060-4e9c-a95b-1b04826c4fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:16.513396 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dee7dc-1060-4e9c-a95b-1b04826c4fa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:16.527055 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:16.659171 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206f60c-6e6c-4527-8090-4f47c7807168 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:16.659549 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dee7dc-1060-4e9c-a95b-1b04826c4fa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:16.661153 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dee7dc-1060-4e9c-a95b-1b04826c4fa5 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:16.700814 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840616b2-330e-4b01-9aeb-fbc05d32566a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:16.702050 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840616b2-330e-4b01-9aeb-fbc05d32566a None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:16.702481 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840616b2-330e-4b01-9aeb-fbc05d32566a None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:16.704205 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840616b2-330e-4b01-9aeb-fbc05d32566a None admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:16.705039 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840616b2-330e-4b01-9aeb-fbc05d32566a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:16.706461 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840616b2-330e-4b01-9aeb-fbc05d32566a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:16.707999 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840616b2-330e-4b01-9aeb-fbc05d32566a None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:16.726792 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 219/423] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:39:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:16.733240 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840616b2-330e-4b01-9aeb-fbc05d32566a None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:16.842359 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 205/424] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:39:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:39:16.845770 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:16.849225 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dee7dc-1060-4e9c-a95b-1b04826c4fa5 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:16.868436 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:16.925975 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840616b2-330e-4b01-9aeb-fbc05d32566a None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:16.997313 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dee7dc-1060-4e9c-a95b-1b04826c4fa5 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:17.010735 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe897b-8c39-4986-aebb-95102231a242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:17.011370 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe897b-8c39-4986-aebb-95102231a242 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:17.011842 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe897b-8c39-4986-aebb-95102231a242 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:17.012288 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe897b-8c39-4986-aebb-95102231a242 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:17.052148 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fb50c-5d28-4a06-8b89-4626eec35d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:17.053532 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fb50c-5d28-4a06-8b89-4626eec35d5e None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:17.054223 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fb50c-5d28-4a06-8b89-4626eec35d5e None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:17.054935 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fb50c-5d28-4a06-8b89-4626eec35d5e None admin] PATH_INFO: `/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:17.057058 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008fb50c-5d28-4a06-8b89-4626eec35d5e None admin] RBAC: Authorizing `identity:get_project(project_id=dd1ea6c1f8214651a9e7c21e90adac21)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:17.060214 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008fb50c-5d28-4a06-8b89-4626eec35d5e None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:17.063956 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 206/425] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:39:16 2022] GET /identity/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:17.069436 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fb50c-5d28-4a06-8b89-4626eec35d5e None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:17.179610 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe897b-8c39-4986-aebb-95102231a242 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:17.179610 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe897b-8c39-4986-aebb-95102231a242 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:17.186797 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:17.257228 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fb50c-5d28-4a06-8b89-4626eec35d5e None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:17.266846 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:17.301186 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 220/426] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:39:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:39:17.302648 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32664a1-0cf3-4c31-ac74-ff4ca8ccffaf None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:17.302937 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32664a1-0cf3-4c31-ac74-ff4ca8ccffaf None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:17.303254 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32664a1-0cf3-4c31-ac74-ff4ca8ccffaf None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:17.304673 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df7b70-a579-44df-afc3-13ef8fecc3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:17.305552 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df7b70-a579-44df-afc3-13ef8fecc3b4 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:17.306029 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df7b70-a579-44df-afc3-13ef8fecc3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:17.306498 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df7b70-a579-44df-afc3-13ef8fecc3b4 None admin] PATH_INFO: `/v3/groups/57dd9a229f754fe0ba34ef400b3062cc` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:17.308649 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df7b70-a579-44df-afc3-13ef8fecc3b4 None admin] RBAC: Authorizing `identity:get_group(group_id=57dd9a229f754fe0ba34ef400b3062cc)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:17.309752 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 221/427] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:17.310606 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32664a1-0cf3-4c31-ac74-ff4ca8ccffaf None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:17.311215 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df7b70-a579-44df-afc3-13ef8fecc3b4 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:17.313245 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 207/428] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 26 00:39:17 2022] GET /identity/v3/groups/57dd9a229f754fe0ba34ef400b3062cc => generated 226 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:17.314897 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be4af9-2e81-41e0-a6e5-661f596da279 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:17.315375 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be4af9-2e81-41e0-a6e5-661f596da279 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:17.315832 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be4af9-2e81-41e0-a6e5-661f596da279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:17.339344 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-a9be4af9-2e81-41e0-a6e5-661f596da279 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:17.341328 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-a9be4af9-2e81-41e0-a6e5-661f596da279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:17.430988 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 208/429] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:39:17.432832 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be4af9-2e81-41e0-a6e5-661f596da279 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:17.466158 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32664a1-0cf3-4c31-ac74-ff4ca8ccffaf None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:17.505204 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:17.548459 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7e733-1880-4958-82f8-88e0b091e730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:17.549443 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7e733-1880-4958-82f8-88e0b091e730 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:17.550643 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7e733-1880-4958-82f8-88e0b091e730 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:17.551107 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7e733-1880-4958-82f8-88e0b091e730 None admin] PATH_INFO: `/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:17.558610 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b7e733-1880-4958-82f8-88e0b091e730 None admin] RBAC: Authorizing `identity:get_project(project_id=dd1ea6c1f8214651a9e7c21e90adac21)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:17.560290 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b7e733-1880-4958-82f8-88e0b091e730 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:17.562411 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 222/430] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:39:17 2022] GET /identity/v3/projects/dd1ea6c1f8214651a9e7c21e90adac21 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:17.570160 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7e733-1880-4958-82f8-88e0b091e730 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:17.590071 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be4af9-2e81-41e0-a6e5-661f596da279 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:17.650204 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d4a99-77bd-4453-965c-f423a8479079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:17.651020 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d4a99-77bd-4453-965c-f423a8479079 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:17.651305 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d4a99-77bd-4453-965c-f423a8479079 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:17.651643 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d4a99-77bd-4453-965c-f423a8479079 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:17.652416 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d4a99-77bd-4453-965c-f423a8479079 None admin] RBAC: Adding query filter params (group.id=57dd9a229f754fe0ba34ef400b3062cc, role.id=64e752fa5df040c1a0b12914b5dacd49, scope.project.id=dd1ea6c1f8214651a9e7c21e90adac21) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:17.652735 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d4a99-77bd-4453-965c-f423a8479079 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:17.654482 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d4a99-77bd-4453-965c-f423a8479079 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:17.658663 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:17.667738 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 209/431] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Aug 26 00:39:17 2022] GET /identity/v3/role_assignments?group.id=57dd9a229f754fe0ba34ef400b3062cc&scope.project.id=dd1ea6c1f8214651a9e7c21e90adac21&role.id=64e752fa5df040c1a0b12914b5dacd49 => generated 611 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:17.728464 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b505b3e-d733-45e2-bda9-5b67a5c26586 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:17.728786 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b505b3e-d733-45e2-bda9-5b67a5c26586 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:17.729109 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b505b3e-d733-45e2-bda9-5b67a5c26586 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:17.730720 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 210/432] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:39:17.745820 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded174a0-0093-43e6-a201-e2cb5ad0f90b None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:17.746624 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded174a0-0093-43e6-a201-e2cb5ad0f90b None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:17.747115 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded174a0-0093-43e6-a201-e2cb5ad0f90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:17.755397 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7e733-1880-4958-82f8-88e0b091e730 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:17.790421 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-ded174a0-0093-43e6-a201-e2cb5ad0f90b None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:17.792239 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-ded174a0-0093-43e6-a201-e2cb5ad0f90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:17.831951 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f87d93-cfe9-4bf8-a34d-6e2e81ceb070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:17.832522 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f87d93-cfe9-4bf8-a34d-6e2e81ceb070 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:17.832804 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f87d93-cfe9-4bf8-a34d-6e2e81ceb070 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:17.833078 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f87d93-cfe9-4bf8-a34d-6e2e81ceb070 None admin] PATH_INFO: `/v3/groups/57dd9a229f754fe0ba34ef400b3062cc` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:17.834314 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f87d93-cfe9-4bf8-a34d-6e2e81ceb070 None admin] RBAC: Authorizing `identity:get_group(group_id=57dd9a229f754fe0ba34ef400b3062cc)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:17.835944 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f87d93-cfe9-4bf8-a34d-6e2e81ceb070 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:17.838838 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 223/433] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 26 00:39:17 2022] GET /identity/v3/groups/57dd9a229f754fe0ba34ef400b3062cc => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:39:17.846637 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f87d93-cfe9-4bf8-a34d-6e2e81ceb070 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:17.937673 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 211/434] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:39:17.938498 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded174a0-0093-43e6-a201-e2cb5ad0f90b None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:18.005065 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f87d93-cfe9-4bf8-a34d-6e2e81ceb070 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:18.009216 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:18.018743 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:18.053560 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e219b35-f03f-4a57-8940-16db433c6933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:18.054181 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e219b35-f03f-4a57-8940-16db433c6933 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:18.054462 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e219b35-f03f-4a57-8940-16db433c6933 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:18.054738 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e219b35-f03f-4a57-8940-16db433c6933 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:18.055550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e219b35-f03f-4a57-8940-16db433c6933 None admin] RBAC: Adding query filter params (group.id=57dd9a229f754fe0ba34ef400b3062cc, role.id=f0a369eda5014bb78b2d752c9abef48f, scope.project.id=dd1ea6c1f8214651a9e7c21e90adac21) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:18.055872 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e219b35-f03f-4a57-8940-16db433c6933 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:18.058354 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e219b35-f03f-4a57-8940-16db433c6933 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:18.065323 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 224/435] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Aug 26 00:39:17 2022] GET /identity/v3/role_assignments?group.id=57dd9a229f754fe0ba34ef400b3062cc&scope.project.id=dd1ea6c1f8214651a9e7c21e90adac21&role.id=f0a369eda5014bb78b2d752c9abef48f => generated 611 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:18.090209 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded174a0-0093-43e6-a201-e2cb5ad0f90b None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:18.131957 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f71802-9120-41c7-a2ee-75b7ad726bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:18.133045 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f71802-9120-41c7-a2ee-75b7ad726bd7 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:18.133570 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f71802-9120-41c7-a2ee-75b7ad726bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:18.134112 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f71802-9120-41c7-a2ee-75b7ad726bd7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:18.149567 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f71802-9120-41c7-a2ee-75b7ad726bd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:39:18.157632 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-77f71802-9120-41c7-a2ee-75b7ad726bd7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:39:18.157632 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:18.157632 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:18.157632 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:18.157632 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:18.157632 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:18.157632 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:18.157632 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:18.157632 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:18.157632 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:18.157632 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:18.157632 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:18.157632 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:39:18.157632 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:39:18.157632 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:39:18.157632 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:39:18.158954 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:39:18.158954 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:39:18.158954 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:39:18.158954 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:39:18.158954 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:18.158954 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:18.158954 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:18.158954 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:18.158954 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:18.158954 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:18.158954 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:18.158954 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:18.158954 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:18.158954 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:18.158954 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:18.158954 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:18.160101 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:18.160101 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:18.160101 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:18.160101 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:18.160101 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:39:18.160101 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:39:18.160101 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:39:18.160101 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:39:18.160101 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:39:18.160101 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:39:18.160101 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:39:18.160101 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:18.163319 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 212/436] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:39:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:18.169862 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e219b35-f03f-4a57-8940-16db433c6933 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:18.321508 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e219b35-f03f-4a57-8940-16db433c6933 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:18.354172 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f71802-9120-41c7-a2ee-75b7ad726bd7 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:18.367236 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155f6e5-624f-4be6-94ab-0e06e5ba255a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:18.367894 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155f6e5-624f-4be6-94ab-0e06e5ba255a None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:18.368181 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155f6e5-624f-4be6-94ab-0e06e5ba255a None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:18.368458 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155f6e5-624f-4be6-94ab-0e06e5ba255a None admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:18.369144 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155f6e5-624f-4be6-94ab-0e06e5ba255a None admin] RBAC: Adding query filter params (name=member) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:18.370479 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155f6e5-624f-4be6-94ab-0e06e5ba255a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:18.371654 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155f6e5-624f-4be6-94ab-0e06e5ba255a None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:18.381496 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 225/437] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 00:39:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:18.387992 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155f6e5-624f-4be6-94ab-0e06e5ba255a None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:18.438169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:18.491200 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f71802-9120-41c7-a2ee-75b7ad726bd7 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:18.495312 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:18.506414 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155f6e5-624f-4be6-94ab-0e06e5ba255a None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:18.535361 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9aff4e-a020-4bfc-9a92-04afe680b158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:18.536048 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9aff4e-a020-4bfc-9a92-04afe680b158 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:18.536377 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9aff4e-a020-4bfc-9a92-04afe680b158 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:18.536657 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9aff4e-a020-4bfc-9a92-04afe680b158 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:18.550787 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9aff4e-a020-4bfc-9a92-04afe680b158 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:39:18.555475 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5d83d-48ba-490a-a005-8564c8236f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:18.555872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-ad9aff4e-a020-4bfc-9a92-04afe680b158 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:39:18.555872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:18.555872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:18.555872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:18.555872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:18.555872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:18.555872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:18.555872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:18.555872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:18.555872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:18.555872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:18.555872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:18.555872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:39:18.555872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:39:18.555872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:39:18.555872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:39:18.557529 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:39:18.557529 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:39:18.557529 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:39:18.557529 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:39:18.557529 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:18.557529 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:18.557529 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:18.557529 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:18.557529 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:18.557529 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:18.557529 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:18.557529 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:18.557529 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:18.557529 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:18.557529 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:18.557529 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:18.558688 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:18.558688 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:18.558688 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:18.558688 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:18.558688 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:39:18.558688 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:39:18.558688 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:39:18.558688 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:39:18.558688 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:39:18.558688 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:39:18.558688 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:39:18.558688 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:18.559311 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5d83d-48ba-490a-a005-8564c8236f87 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:18.559311 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5d83d-48ba-490a-a005-8564c8236f87 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:18.559311 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5d83d-48ba-490a-a005-8564c8236f87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:18.562557 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 213/438] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 00:39:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:39:18.567192 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9aff4e-a020-4bfc-9a92-04afe680b158 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:18.653437 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5d83d-48ba-490a-a005-8564c8236f87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:18.654839 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5d83d-48ba-490a-a005-8564c8236f87 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:18.698018 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:18.704120 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9aff4e-a020-4bfc-9a92-04afe680b158 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:18.744094 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48137173-d41c-411d-be17-6577bbf341ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:18.745300 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48137173-d41c-411d-be17-6577bbf341ec None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:18.745707 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48137173-d41c-411d-be17-6577bbf341ec None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:18.745998 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48137173-d41c-411d-be17-6577bbf341ec None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:18.746680 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48137173-d41c-411d-be17-6577bbf341ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:18.746994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48137173-d41c-411d-be17-6577bbf341ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:18.748380 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48137173-d41c-411d-be17-6577bbf341ec None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:18.756532 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 214/439] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:39:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:39:18.757867 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3229062-9df3-47f4-bdd5-acd628de8ec5 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:18.758167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3229062-9df3-47f4-bdd5-acd628de8ec5 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:18.758450 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3229062-9df3-47f4-bdd5-acd628de8ec5 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:18.759652 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 215/440] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:18.762299 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3229062-9df3-47f4-bdd5-acd628de8ec5 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:18.778712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 226/441] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:39:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:39:18.779985 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c1733-93ea-4337-a874-42fb73209693 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:18.780365 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c1733-93ea-4337-a874-42fb73209693 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:18.780570 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c1733-93ea-4337-a874-42fb73209693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:18.794529 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:18.799881 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-5d6c1733-93ea-4337-a874-42fb73209693 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:18.801348 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-5d6c1733-93ea-4337-a874-42fb73209693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:18.870878 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 227/442] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:39:18.871743 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c1733-93ea-4337-a874-42fb73209693 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:18.873166 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3229062-9df3-47f4-bdd5-acd628de8ec5 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:18.913867 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc4cec-10d8-43ee-8349-9f67f3b3bd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:18.914484 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc4cec-10d8-43ee-8349-9f67f3b3bd99 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:18.914769 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc4cec-10d8-43ee-8349-9f67f3b3bd99 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:18.915046 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc4cec-10d8-43ee-8349-9f67f3b3bd99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:18.960591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:18.993537 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc4cec-10d8-43ee-8349-9f67f3b3bd99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:18.995308 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc4cec-10d8-43ee-8349-9f67f3b3bd99 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:19.002440 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c1733-93ea-4337-a874-42fb73209693 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:19.021815 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:19.041255 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00c582-c779-4551-b8f1-06b8ab400657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:19.042726 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00c582-c779-4551-b8f1-06b8ab400657 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:19.043013 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00c582-c779-4551-b8f1-06b8ab400657 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:19.043291 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00c582-c779-4551-b8f1-06b8ab400657 None admin] PATH_INFO: `/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:19.044458 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00c582-c779-4551-b8f1-06b8ab400657 None admin] RBAC: Authorizing `identity:get_project(project_id=0cb207b03a6c4bee8b0f421096a2b4fc)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:19.045958 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00c582-c779-4551-b8f1-06b8ab400657 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:19.047631 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 228/443] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:39:18 2022] GET /identity/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:19.053863 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00c582-c779-4551-b8f1-06b8ab400657 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:19.117200 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 216/444] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:39:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 00:39:19.123525 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc4cec-10d8-43ee-8349-9f67f3b3bd99 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:19.169172 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00c582-c779-4551-b8f1-06b8ab400657 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:19.202798 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:19.207565 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3223a64-939e-4138-a21c-dbbc10606bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:19.208197 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3223a64-939e-4138-a21c-dbbc10606bca None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:19.208592 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3223a64-939e-4138-a21c-dbbc10606bca None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:19.208779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3223a64-939e-4138-a21c-dbbc10606bca None admin] PATH_INFO: `/v3/groups/57dd9a229f754fe0ba34ef400b3062cc` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:19.209935 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3223a64-939e-4138-a21c-dbbc10606bca None admin] RBAC: Authorizing `identity:get_group(group_id=57dd9a229f754fe0ba34ef400b3062cc)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:19.211361 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3223a64-939e-4138-a21c-dbbc10606bca None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:19.212928 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 229/445] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 26 00:39:19 2022] GET /identity/v3/groups/57dd9a229f754fe0ba34ef400b3062cc => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:19.218293 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3223a64-939e-4138-a21c-dbbc10606bca None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:19.232255 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc4cec-10d8-43ee-8349-9f67f3b3bd99 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:19.256566 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:19.267145 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d6b5b-4801-4910-866a-7fda86f5349c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:19.272536 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d6b5b-4801-4910-866a-7fda86f5349c None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:19.272536 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d6b5b-4801-4910-866a-7fda86f5349c None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:19.272536 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d6b5b-4801-4910-866a-7fda86f5349c None admin] PATH_INFO: `/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:19.272536 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d6b5b-4801-4910-866a-7fda86f5349c None admin] RBAC: Authorizing `identity:get_project(project_id=0cb207b03a6c4bee8b0f421096a2b4fc)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:19.272536 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d6b5b-4801-4910-866a-7fda86f5349c None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:19.272984 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 217/446] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:39:19 2022] GET /identity/v3/projects/0cb207b03a6c4bee8b0f421096a2b4fc => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:39:19.273472 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d6b5b-4801-4910-866a-7fda86f5349c None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:19.327933 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3223a64-939e-4138-a21c-dbbc10606bca None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:19.362287 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b70077-b700-4e43-b94e-44458220ab4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:19.362911 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b70077-b700-4e43-b94e-44458220ab4e None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:19.363195 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b70077-b700-4e43-b94e-44458220ab4e None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:19.363472 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b70077-b700-4e43-b94e-44458220ab4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:19.375191 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b70077-b700-4e43-b94e-44458220ab4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:39:19.378122 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d6b5b-4801-4910-866a-7fda86f5349c None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:19.380462 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-e8b70077-b700-4e43-b94e-44458220ab4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:39:19.380462 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:19.380462 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:19.380462 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:19.380462 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:19.380462 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:19.380462 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:19.380462 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:19.380462 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:19.380462 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:19.380462 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:19.380462 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:19.380462 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:39:19.380462 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:39:19.380462 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:39:19.380462 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:39:19.381835 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:39:19.381835 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:39:19.381835 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:39:19.381835 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:39:19.381835 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:19.381835 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:19.381835 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:19.381835 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:19.381835 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:19.381835 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:19.381835 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:19.381835 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:19.381835 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:19.381835 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:19.381835 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:19.381835 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:19.382612 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:19.382612 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:19.382612 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:19.382612 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:19.382612 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:39:19.382612 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:39:19.382612 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:39:19.382612 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:39:19.382612 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:39:19.382612 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:39:19.382612 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:39:19.382612 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:19.382612 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 230/447] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 00:39:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:19.383274 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b70077-b700-4e43-b94e-44458220ab4e None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:19.414628 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ffc89-e07d-4f42-8c37-9ae32fdc022e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:19.415246 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ffc89-e07d-4f42-8c37-9ae32fdc022e None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:19.415536 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ffc89-e07d-4f42-8c37-9ae32fdc022e None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:19.415818 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ffc89-e07d-4f42-8c37-9ae32fdc022e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:19.417093 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ffc89-e07d-4f42-8c37-9ae32fdc022e None admin] RBAC: Adding query filter params (group.id=57dd9a229f754fe0ba34ef400b3062cc, role.id=64e752fa5df040c1a0b12914b5dacd49, scope.project.id=0cb207b03a6c4bee8b0f421096a2b4fc) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:19.417437 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ffc89-e07d-4f42-8c37-9ae32fdc022e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:19.418897 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ffc89-e07d-4f42-8c37-9ae32fdc022e None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:19.425229 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 218/448] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Aug 26 00:39:19 2022] GET /identity/v3/role_assignments?group.id=57dd9a229f754fe0ba34ef400b3062cc&scope.project.id=0cb207b03a6c4bee8b0f421096a2b4fc&role.id=64e752fa5df040c1a0b12914b5dacd49 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:19.426039 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ffc89-e07d-4f42-8c37-9ae32fdc022e None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:19.450945 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:19.505186 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b70077-b700-4e43-b94e-44458220ab4e None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:19.506600 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:19.547520 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa2b80-8cb8-4829-b444-b7e4949e93b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:19.547520 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa2b80-8cb8-4829-b444-b7e4949e93b5 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:19.547520 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa2b80-8cb8-4829-b444-b7e4949e93b5 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:19.547911 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa2b80-8cb8-4829-b444-b7e4949e93b5 None admin] PATH_INFO: `/v3/groups/57dd9a229f754fe0ba34ef400b3062cc` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:19.548740 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa2b80-8cb8-4829-b444-b7e4949e93b5 None admin] RBAC: Authorizing `identity:get_group(group_id=57dd9a229f754fe0ba34ef400b3062cc)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:19.550500 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa2b80-8cb8-4829-b444-b7e4949e93b5 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:19.552125 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 231/449] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 26 00:39:19 2022] GET /identity/v3/groups/57dd9a229f754fe0ba34ef400b3062cc => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:19.558891 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa2b80-8cb8-4829-b444-b7e4949e93b5 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:19.576117 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ffc89-e07d-4f42-8c37-9ae32fdc022e None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:19.616403 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a313b2-196c-4d83-aeab-2ba1a15ebd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:19.617054 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a313b2-196c-4d83-aeab-2ba1a15ebd62 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:19.617710 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a313b2-196c-4d83-aeab-2ba1a15ebd62 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:19.617710 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a313b2-196c-4d83-aeab-2ba1a15ebd62 None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:19.618308 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a313b2-196c-4d83-aeab-2ba1a15ebd62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:19.619347 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a313b2-196c-4d83-aeab-2ba1a15ebd62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:19.620341 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a313b2-196c-4d83-aeab-2ba1a15ebd62 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:19.629964 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 219/450] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:39:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:19.636484 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a313b2-196c-4d83-aeab-2ba1a15ebd62 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:19.677849 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa2b80-8cb8-4829-b444-b7e4949e93b5 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:19.709048 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:19.722275 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235f0c5-01cf-4811-b43e-510f2aae544e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:19.723113 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235f0c5-01cf-4811-b43e-510f2aae544e None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:19.723221 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235f0c5-01cf-4811-b43e-510f2aae544e None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:19.723410 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235f0c5-01cf-4811-b43e-510f2aae544e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:19.724195 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235f0c5-01cf-4811-b43e-510f2aae544e None admin] RBAC: Adding query filter params (group.id=57dd9a229f754fe0ba34ef400b3062cc, role.id=f0a369eda5014bb78b2d752c9abef48f, scope.project.id=0cb207b03a6c4bee8b0f421096a2b4fc) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:19.724473 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235f0c5-01cf-4811-b43e-510f2aae544e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:19.725965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235f0c5-01cf-4811-b43e-510f2aae544e None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:19.732999 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 232/451] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Aug 26 00:39:19 2022] GET /identity/v3/role_assignments?group.id=57dd9a229f754fe0ba34ef400b3062cc&scope.project.id=0cb207b03a6c4bee8b0f421096a2b4fc&role.id=f0a369eda5014bb78b2d752c9abef48f => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:39:19.769837 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a313b2-196c-4d83-aeab-2ba1a15ebd62 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:19.790622 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:19.816364 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa9ff3-55af-4faa-93f2-35b1ed8f6dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:19.817055 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa9ff3-55af-4faa-93f2-35b1ed8f6dcf None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:19.817344 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa9ff3-55af-4faa-93f2-35b1ed8f6dcf None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:19.817739 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa9ff3-55af-4faa-93f2-35b1ed8f6dcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:19.904076 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa9ff3-55af-4faa-93f2-35b1ed8f6dcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:19.905614 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa9ff3-55af-4faa-93f2-35b1ed8f6dcf None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:20.015570 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 220/452] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:39:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 00:39:20.021357 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235f0c5-01cf-4811-b43e-510f2aae544e None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:20.128718 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235f0c5-01cf-4811-b43e-510f2aae544e None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:20.163741 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d136b0-cf05-47b8-b4e2-baab4d5edc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:20.164372 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d136b0-cf05-47b8-b4e2-baab4d5edc84 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:20.164657 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d136b0-cf05-47b8-b4e2-baab4d5edc84 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:20.164938 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d136b0-cf05-47b8-b4e2-baab4d5edc84 None admin] PATH_INFO: `/v3/projects/d490d60fce834824a5c1595cbd7a1ebe` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:20.166367 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d136b0-cf05-47b8-b4e2-baab4d5edc84 None admin] RBAC: Authorizing `identity:get_project(project_id=d490d60fce834824a5c1595cbd7a1ebe)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:20.167918 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d136b0-cf05-47b8-b4e2-baab4d5edc84 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:20.169628 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 233/453] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 26 00:39:20 2022] GET /identity/v3/projects/d490d60fce834824a5c1595cbd7a1ebe => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:20.175544 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa9ff3-55af-4faa-93f2-35b1ed8f6dcf None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:20.194179 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:20.278398 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa9ff3-55af-4faa-93f2-35b1ed8f6dcf None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:20.313536 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936eee2-35b2-4301-badd-e06fd366ecb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:20.314155 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936eee2-35b2-4301-badd-e06fd366ecb1 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:20.314437 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936eee2-35b2-4301-badd-e06fd366ecb1 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:20.314706 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936eee2-35b2-4301-badd-e06fd366ecb1 None admin] PATH_INFO: `/v3/groups/b3774956b1f343f394b941f682148cfb` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:20.315803 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936eee2-35b2-4301-badd-e06fd366ecb1 None admin] RBAC: Authorizing `identity:get_group(group_id=b3774956b1f343f394b941f682148cfb)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:20.317234 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936eee2-35b2-4301-badd-e06fd366ecb1 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:20.318811 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 221/454] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 26 00:39:20 2022] GET /identity/v3/groups/b3774956b1f343f394b941f682148cfb => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:20.325494 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d136b0-cf05-47b8-b4e2-baab4d5edc84 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:20.389364 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:20.430749 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d136b0-cf05-47b8-b4e2-baab4d5edc84 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:20.469128 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9467b-07a9-4f34-9606-c160e7ccae5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:20.469128 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9467b-07a9-4f34-9606-c160e7ccae5a None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:20.469128 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9467b-07a9-4f34-9606-c160e7ccae5a None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:20.469128 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9467b-07a9-4f34-9606-c160e7ccae5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:20.469587 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9467b-07a9-4f34-9606-c160e7ccae5a None admin] RBAC: Adding query filter params (group.id=b3774956b1f343f394b941f682148cfb, role.id=f13055bcebf847bf8b46160ded13810b, scope.project.id=d490d60fce834824a5c1595cbd7a1ebe) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:20.469587 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9467b-07a9-4f34-9606-c160e7ccae5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:20.470802 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9467b-07a9-4f34-9606-c160e7ccae5a None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:20.476896 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 234/455] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Aug 26 00:39:20 2022] GET /identity/v3/role_assignments?group.id=b3774956b1f343f394b941f682148cfb&scope.project.id=d490d60fce834824a5c1595cbd7a1ebe&role.id=f13055bcebf847bf8b46160ded13810b => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:23.094410 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439578f-de68-4449-8e1c-8a21312c3736 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:23.094992 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439578f-de68-4449-8e1c-8a21312c3736 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:23.094992 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439578f-de68-4449-8e1c-8a21312c3736 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:23.096564 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 222/456] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:23.102479 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6bd32-8dca-470e-887a-d69f5ab59ad6 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:23.103072 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6bd32-8dca-470e-887a-d69f5ab59ad6 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:23.103072 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6bd32-8dca-470e-887a-d69f5ab59ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:23.129699 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-cec6bd32-8dca-470e-887a-d69f5ab59ad6 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:23.130931 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-cec6bd32-8dca-470e-887a-d69f5ab59ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:23.215282 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 235/457] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:39:23.333256 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9162c-896b-4202-9107-312d13875f95 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:23.333651 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9162c-896b-4202-9107-312d13875f95 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:23.334164 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9162c-896b-4202-9107-312d13875f95 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:23.335986 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 223/458] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:23.341963 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ebf21-3d97-46f7-a3f5-8e1ed141aa0b None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:23.342509 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ebf21-3d97-46f7-a3f5-8e1ed141aa0b None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:23.342975 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ebf21-3d97-46f7-a3f5-8e1ed141aa0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:23.366806 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-3e2ebf21-3d97-46f7-a3f5-8e1ed141aa0b None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:23.368252 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-3e2ebf21-3d97-46f7-a3f5-8e1ed141aa0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:23.427122 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:23.447913 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 236/459] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:39:23.470306 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867a5b7-6ad6-4ae8-a42a-9fe4746f63b0 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:23.470494 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867a5b7-6ad6-4ae8-a42a-9fe4746f63b0 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:23.470760 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867a5b7-6ad6-4ae8-a42a-9fe4746f63b0 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:23.472387 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 224/460] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:23.477953 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05125f6-2c03-433c-a706-27703a0fc5c2 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:23.478951 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05125f6-2c03-433c-a706-27703a0fc5c2 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:23.483804 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05125f6-2c03-433c-a706-27703a0fc5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:23.502182 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-e05125f6-2c03-433c-a706-27703a0fc5c2 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:23.503414 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-e05125f6-2c03-433c-a706-27703a0fc5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:23.585193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867a5b7-6ad6-4ae8-a42a-9fe4746f63b0 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:23.617944 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 237/461] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:39:23.692145 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:23.709549 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867a5b7-6ad6-4ae8-a42a-9fe4746f63b0 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:23.749062 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72181aef-3430-495f-ad94-2ac5fd01d265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:23.750166 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72181aef-3430-495f-ad94-2ac5fd01d265 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:23.750673 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72181aef-3430-495f-ad94-2ac5fd01d265 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:23.751172 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72181aef-3430-495f-ad94-2ac5fd01d265 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:23.764055 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72181aef-3430-495f-ad94-2ac5fd01d265 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:23.765987 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72181aef-3430-495f-ad94-2ac5fd01d265 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:23.783564 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c031f96-713d-4ec6-af09-b8bad53025ff None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:23.783873 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c031f96-713d-4ec6-af09-b8bad53025ff None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:23.784121 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c031f96-713d-4ec6-af09-b8bad53025ff None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:23.784780 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-72181aef-3430-495f-ad94-2ac5fd01d265 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:23.784780 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:23.784780 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:23.784780 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:23.784780 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:23.784780 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:23.784780 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:23.784780 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:23.784780 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:23.784780 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:23.784780 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:23.784780 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:23.784780 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:39:23.784780 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:39:23.784780 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:39:23.784780 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:39:23.785692 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:23.785692 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:23.785692 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:23.785692 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:23.785692 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:23.785692 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:23.785692 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:23.785692 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:23.785692 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:23.785692 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:23.785692 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:23.785692 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:23.785692 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:23.785692 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:23.785692 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:23.785692 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:23.785692 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:39:23.786652 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:39:23.786652 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:23.786652 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:23.786818 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 238/462] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:39:23.788836 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 225/463] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:23.790291 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c031f96-713d-4ec6-af09-b8bad53025ff None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:23.791682 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33c85a-787f-45da-af83-df80dd503c47 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:23.792188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33c85a-787f-45da-af83-df80dd503c47 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:23.792682 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33c85a-787f-45da-af83-df80dd503c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:23.814869 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-fa33c85a-787f-45da-af83-df80dd503c47 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:23.816160 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-fa33c85a-787f-45da-af83-df80dd503c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:23.894667 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 226/464] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:39:23.895355 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33c85a-787f-45da-af83-df80dd503c47 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:23.913397 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c031f96-713d-4ec6-af09-b8bad53025ff None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:23.928925 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:23.956542 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c6320-17b4-4b61-acfd-112fb827c767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:23.957518 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c6320-17b4-4b61-acfd-112fb827c767 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:23.958142 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c6320-17b4-4b61-acfd-112fb827c767 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:23.958651 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c6320-17b4-4b61-acfd-112fb827c767 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:23.970012 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c6320-17b4-4b61-acfd-112fb827c767 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:23.972108 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c6320-17b4-4b61-acfd-112fb827c767 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:23.982637 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:23.987898 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-471c6320-17b4-4b61-acfd-112fb827c767 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:23.987898 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:23.987898 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:23.987898 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:23.987898 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:23.987898 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:23.987898 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:23.987898 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:23.987898 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:23.987898 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:23.987898 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:23.987898 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:23.987898 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:39:23.987898 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:39:23.987898 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:39:23.987898 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:39:23.989008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:23.989008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:23.989008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:23.989008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:23.989008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:23.989008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:23.989008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:23.989008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:23.989008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:23.989008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:23.989008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:23.989008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:23.989008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:23.989008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:23.989008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:23.989008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:23.989008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:39:23.989961 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:39:23.989961 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:23.989961 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:23.993614 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 239/465] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:23.995590 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c6320-17b4-4b61-acfd-112fb827c767 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:24.023310 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33c85a-787f-45da-af83-df80dd503c47 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:24.063651 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3896daf-bbf1-4b04-96f0-126614358dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:24.064275 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3896daf-bbf1-4b04-96f0-126614358dec None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:24.064554 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3896daf-bbf1-4b04-96f0-126614358dec None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:24.064828 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3896daf-bbf1-4b04-96f0-126614358dec None admin] PATH_INFO: `/v3/domains` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:24.065760 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3896daf-bbf1-4b04-96f0-126614358dec None admin] RBAC: Adding query filter params (name=Default) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:24.066065 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3896daf-bbf1-4b04-96f0-126614358dec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:24.068376 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3896daf-bbf1-4b04-96f0-126614358dec None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:24.088782 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 227/466] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:24.089713 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3896daf-bbf1-4b04-96f0-126614358dec None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:24.111125 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c6320-17b4-4b61-acfd-112fb827c767 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:24.150761 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423a45b-f80a-40b9-81e9-a2772ede8350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:24.151512 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423a45b-f80a-40b9-81e9-a2772ede8350 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:24.151829 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423a45b-f80a-40b9-81e9-a2772ede8350 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:24.152104 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423a45b-f80a-40b9-81e9-a2772ede8350 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:24.164055 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423a45b-f80a-40b9-81e9-a2772ede8350 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:24.165713 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423a45b-f80a-40b9-81e9-a2772ede8350 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:24.182563 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-6423a45b-f80a-40b9-81e9-a2772ede8350 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:24.182563 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:24.182563 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:24.182563 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:24.182563 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:24.182563 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:24.182563 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:24.182563 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:24.182563 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:24.182563 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:24.182563 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:24.182563 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:24.182563 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:39:24.182563 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:39:24.182563 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:39:24.182563 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:39:24.188738 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:24.188738 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:24.188738 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:24.188738 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:24.188738 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:24.188738 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:24.188738 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:24.188738 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:24.188738 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:24.188738 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:24.188738 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:24.188738 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:24.188738 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:24.188738 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:24.188738 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:24.188738 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:24.188738 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:39:24.189748 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:39:24.189748 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:24.189748 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:24.189748 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 240/467] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:24.189748 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423a45b-f80a-40b9-81e9-a2772ede8350 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:24.209701 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:24.210221 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3896daf-bbf1-4b04-96f0-126614358dec None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:24.239433 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:24.252168 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57741a99-027f-4101-b78f-0fdc479912bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:24.252788 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57741a99-027f-4101-b78f-0fdc479912bd None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:24.253067 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57741a99-027f-4101-b78f-0fdc479912bd None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:24.253342 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57741a99-027f-4101-b78f-0fdc479912bd None admin] PATH_INFO: `/v3/domains` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:24.254032 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57741a99-027f-4101-b78f-0fdc479912bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:24.254341 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57741a99-027f-4101-b78f-0fdc479912bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:24.255758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57741a99-027f-4101-b78f-0fdc479912bd None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:24.272618 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 228/468] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:24.272618 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57741a99-027f-4101-b78f-0fdc479912bd None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:24.301989 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423a45b-f80a-40b9-81e9-a2772ede8350 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:24.339470 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5156f20-fc0f-4896-8776-ee801b2c0679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:24.340019 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5156f20-fc0f-4896-8776-ee801b2c0679 None admin] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:24.340610 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5156f20-fc0f-4896-8776-ee801b2c0679 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:24.340949 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5156f20-fc0f-4896-8776-ee801b2c0679 None admin] PATH_INFO: `/v3/users` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:24.341648 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5156f20-fc0f-4896-8776-ee801b2c0679 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:24.343244 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5156f20-fc0f-4896-8776-ee801b2c0679 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:24.380488 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57741a99-027f-4101-b78f-0fdc479912bd None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:24.414583 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2856888e-7572-43e2-9e15-ed55ff5239ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:24.415192 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856888e-7572-43e2-9e15-ed55ff5239ae None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:24.415474 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856888e-7572-43e2-9e15-ed55ff5239ae None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:24.415748 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856888e-7572-43e2-9e15-ed55ff5239ae None admin] PATH_INFO: `/v3/domains` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:24.416948 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2856888e-7572-43e2-9e15-ed55ff5239ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:24.417250 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2856888e-7572-43e2-9e15-ed55ff5239ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:24.418834 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2856888e-7572-43e2-9e15-ed55ff5239ae None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:24.431531 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 229/469] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:24.432839 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2856888e-7572-43e2-9e15-ed55ff5239ae None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:24.452318 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 241/470] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 26 00:39:24 2022] POST /identity/v3/users => generated 246 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:24.453336 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5156f20-fc0f-4896-8776-ee801b2c0679 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:24.489833 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:24.544455 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:24.554743 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2856888e-7572-43e2-9e15-ed55ff5239ae None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:24.577750 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5156f20-fc0f-4896-8776-ee801b2c0679 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:24.596501 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37576b74-8e68-451c-b2c1-30591a3d5997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:24.597651 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37576b74-8e68-451c-b2c1-30591a3d5997 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:24.598180 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37576b74-8e68-451c-b2c1-30591a3d5997 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:24.598643 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37576b74-8e68-451c-b2c1-30591a3d5997 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:24.612629 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37576b74-8e68-451c-b2c1-30591a3d5997 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:24.614513 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37576b74-8e68-451c-b2c1-30591a3d5997 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:24.616311 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4aad6c-9755-4011-b185-84b262cdf93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:24.616939 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aad6c-9755-4011-b185-84b262cdf93d None admin] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:24.621321 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aad6c-9755-4011-b185-84b262cdf93d None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:24.621321 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aad6c-9755-4011-b185-84b262cdf93d None admin] PATH_INFO: `/v3/users` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:24.621321 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4aad6c-9755-4011-b185-84b262cdf93d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:24.621321 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4aad6c-9755-4011-b185-84b262cdf93d None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:24.634008 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-37576b74-8e68-451c-b2c1-30591a3d5997 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:24.634008 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:24.634008 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:24.634008 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:24.634008 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:24.634008 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:24.634008 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:24.634008 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:24.634008 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:24.634008 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:24.634008 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:24.634008 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:24.634008 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:39:24.634008 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:39:24.634008 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:39:24.634008 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:39:24.635086 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:24.635086 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:24.635086 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:24.635086 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:24.635086 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:24.635086 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:24.635086 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:24.635086 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:24.635086 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:24.635086 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:24.635086 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:24.635086 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:24.635086 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:24.635086 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:24.635086 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:24.635086 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:24.635086 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:39:24.636148 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:39:24.636148 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:24.636148 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:24.636148 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 230/471] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:24.636148 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37576b74-8e68-451c-b2c1-30591a3d5997 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:24.738906 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 242/472] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 26 00:39:24 2022] POST /identity/v3/users => generated 248 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:24.738906 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4aad6c-9755-4011-b185-84b262cdf93d None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:24.785693 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:24.789586 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37576b74-8e68-451c-b2c1-30591a3d5997 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:24.831871 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becebd8e-fd11-44da-9d67-a2624dd93d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:24.833061 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becebd8e-fd11-44da-9d67-a2624dd93d0e None admin] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:24.833061 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becebd8e-fd11-44da-9d67-a2624dd93d0e None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:24.833061 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becebd8e-fd11-44da-9d67-a2624dd93d0e None admin] PATH_INFO: `/v3/users` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:24.833830 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becebd8e-fd11-44da-9d67-a2624dd93d0e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:24.835402 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becebd8e-fd11-44da-9d67-a2624dd93d0e None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:24.877879 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4aad6c-9755-4011-b185-84b262cdf93d None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:24.924054 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:24.931165 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c81c26-961e-4300-916f-5bd5c100748b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:24.931928 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c81c26-961e-4300-916f-5bd5c100748b None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:24.932212 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c81c26-961e-4300-916f-5bd5c100748b None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:24.932879 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c81c26-961e-4300-916f-5bd5c100748b None admin] PATH_INFO: `/v3/domains` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:24.933297 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c81c26-961e-4300-916f-5bd5c100748b None admin] RBAC: Adding query filter params (name=Default) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:24.933646 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c81c26-961e-4300-916f-5bd5c100748b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:24.935146 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c81c26-961e-4300-916f-5bd5c100748b None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:24.951054 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 243/473] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:24.959113 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c81c26-961e-4300-916f-5bd5c100748b None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:24.966622 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 231/474] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 26 00:39:24 2022] POST /identity/v3/users => generated 248 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:25.098247 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c81c26-961e-4300-916f-5bd5c100748b None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:25.140241 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15238c-3d4d-4cfe-b9e3-da9eaac942a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:25.140888 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15238c-3d4d-4cfe-b9e3-da9eaac942a2 None admin] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:25.141145 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15238c-3d4d-4cfe-b9e3-da9eaac942a2 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:25.141460 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15238c-3d4d-4cfe-b9e3-da9eaac942a2 None admin] PATH_INFO: `/v3/users` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:25.142127 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15238c-3d4d-4cfe-b9e3-da9eaac942a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:25.143627 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15238c-3d4d-4cfe-b9e3-da9eaac942a2 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:25.274852 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 244/475] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 26 00:39:24 2022] POST /identity/v3/users => generated 249 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:39:26.803546 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2970a66-e682-4fb0-a79e-a2b1ae9a6c70 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:26.804366 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2970a66-e682-4fb0-a79e-a2b1ae9a6c70 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:26.804618 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2970a66-e682-4fb0-a79e-a2b1ae9a6c70 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:26.807828 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 232/476] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:26.817314 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e62966-f063-40fe-bdb3-1ecc9a233c2a None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:26.818345 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e62966-f063-40fe-bdb3-1ecc9a233c2a None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:26.818345 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e62966-f063-40fe-bdb3-1ecc9a233c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:26.852929 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-31e62966-f063-40fe-bdb3-1ecc9a233c2a None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:26.855175 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-31e62966-f063-40fe-bdb3-1ecc9a233c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:26.961554 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:27.011359 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 245/477] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:39:27.621300 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2970a66-e682-4fb0-a79e-a2b1ae9a6c70 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:27.701468 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c7519-8cec-4bac-8013-9e6c681f22b1 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:27.701819 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c7519-8cec-4bac-8013-9e6c681f22b1 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:27.702064 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c7519-8cec-4bac-8013-9e6c681f22b1 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:27.703715 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 246/478] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:39:27.711094 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef7f62-e9ab-4a67-860e-acc0982c3151 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:27.711376 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef7f62-e9ab-4a67-860e-acc0982c3151 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:27.711662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef7f62-e9ab-4a67-860e-acc0982c3151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:27.734485 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-83ef7f62-e9ab-4a67-860e-acc0982c3151 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:27.735754 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-83ef7f62-e9ab-4a67-860e-acc0982c3151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:27.799642 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2970a66-e682-4fb0-a79e-a2b1ae9a6c70 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:27.849436 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 247/479] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:39:27.850829 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a4c01-21a7-44be-8bb9-7eba5e20b2ad None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:27.851119 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a4c01-21a7-44be-8bb9-7eba5e20b2ad None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:27.851419 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a4c01-21a7-44be-8bb9-7eba5e20b2ad None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:27.852890 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 248/480] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:27.858938 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3a4ae-3cdf-4f09-849a-7f35cec5951a None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:27.859290 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3a4ae-3cdf-4f09-849a-7f35cec5951a None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:27.859535 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3a4ae-3cdf-4f09-849a-7f35cec5951a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:27.869722 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48bd49-6e30-40c8-89ff-5ae227d2e5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:27.871774 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48bd49-6e30-40c8-89ff-5ae227d2e5b2 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:27.872595 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48bd49-6e30-40c8-89ff-5ae227d2e5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:27.873315 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48bd49-6e30-40c8-89ff-5ae227d2e5b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:27.878300 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-66b3a4ae-3cdf-4f09-849a-7f35cec5951a None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:27.879593 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-66b3a4ae-3cdf-4f09-849a-7f35cec5951a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:27.895345 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48bd49-6e30-40c8-89ff-5ae227d2e5b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:39:27.918392 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-4f48bd49-6e30-40c8-89ff-5ae227d2e5b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:39:27.918392 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:27.918392 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:27.918392 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:27.918392 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:27.918392 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:27.918392 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:27.918392 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:27.918392 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:27.918392 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:27.918392 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:27.918392 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:27.918392 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:39:27.918392 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:39:27.918392 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:39:27.918392 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:39:27.919348 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:39:27.919348 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:39:27.919348 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:39:27.919348 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:39:27.919348 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:27.919348 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:27.919348 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:27.919348 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:27.919348 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:27.919348 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:27.919348 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:27.919348 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:27.919348 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:27.919348 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:27.919348 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:27.919348 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:27.920131 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:27.920131 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:27.920131 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:27.920131 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:27.920131 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:39:27.920131 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:39:27.920131 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:39:27.920131 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:39:27.920131 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:39:27.920131 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:39:27.920131 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:39:27.920131 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:27.925721 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 233/481] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 00:39:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:27.931206 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48bd49-6e30-40c8-89ff-5ae227d2e5b2 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:27.961550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 249/482] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:39:27.975497 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:28.124112 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48bd49-6e30-40c8-89ff-5ae227d2e5b2 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:28.188371 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ae011-db6f-48f4-831b-be60cb32a97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:28.189405 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ae011-db6f-48f4-831b-be60cb32a97a None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:28.189909 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ae011-db6f-48f4-831b-be60cb32a97a None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:28.190416 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ae011-db6f-48f4-831b-be60cb32a97a None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:28.191590 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ae011-db6f-48f4-831b-be60cb32a97a None admin] RBAC: Adding query filter params (name=service) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:28.192179 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ae011-db6f-48f4-831b-be60cb32a97a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:28.194721 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ae011-db6f-48f4-831b-be60cb32a97a None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:28.206116 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3a4ae-3cdf-4f09-849a-7f35cec5951a None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:28.210553 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 234/483] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 00:39:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:28.219950 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ae011-db6f-48f4-831b-be60cb32a97a None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:28.243815 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:28.314958 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3a4ae-3cdf-4f09-849a-7f35cec5951a None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:28.358562 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f5e43-099e-4530-9a04-be0a5d621f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:28.359281 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f5e43-099e-4530-9a04-be0a5d621f50 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:28.359503 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f5e43-099e-4530-9a04-be0a5d621f50 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:28.359771 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f5e43-099e-4530-9a04-be0a5d621f50 None admin] PATH_INFO: `/v3/roles/service` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:28.368860 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:28.374501 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f5e43-099e-4530-9a04-be0a5d621f50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:39:28.379340 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-8f9f5e43-099e-4530-9a04-be0a5d621f50 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:39:28.379340 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:28.379340 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:28.379340 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:28.379340 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:28.379340 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:28.379340 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:28.379340 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:28.379340 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:28.379340 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:28.379340 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:28.379340 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:28.379340 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:39:28.379340 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:39:28.379340 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:39:28.379340 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:39:28.389026 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:39:28.389026 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:39:28.389026 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:39:28.389026 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:39:28.389026 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:28.389026 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:28.389026 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:28.389026 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:28.389026 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:28.389026 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:28.389026 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:28.389026 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:28.389026 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:28.389026 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:28.389026 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:28.389026 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:28.390601 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:28.390601 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:28.390601 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:28.390601 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:28.390601 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:39:28.390601 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:39:28.390601 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:39:28.390601 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:39:28.390601 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:39:28.390601 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:39:28.390601 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:39:28.390601 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:28.390601 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 250/484] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 00:39:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:39:28.390601 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f5e43-099e-4530-9a04-be0a5d621f50 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:28.405117 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ae011-db6f-48f4-831b-be60cb32a97a None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:28.448233 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab28b1-e605-4646-ad59-f58533572097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:28.449072 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab28b1-e605-4646-ad59-f58533572097 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:28.449357 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab28b1-e605-4646-ad59-f58533572097 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:28.449666 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab28b1-e605-4646-ad59-f58533572097 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:28.462791 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab28b1-e605-4646-ad59-f58533572097 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:28.465588 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab28b1-e605-4646-ad59-f58533572097 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:28.481830 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-57ab28b1-e605-4646-ad59-f58533572097 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:28.481830 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:28.481830 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:28.481830 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:28.481830 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:28.481830 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:28.481830 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:28.481830 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:28.481830 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:28.481830 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:28.481830 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:28.481830 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:28.481830 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:39:28.481830 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:39:28.481830 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:39:28.481830 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:39:28.483854 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:28.483854 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:28.483854 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:28.483854 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:28.483854 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:28.483854 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:28.483854 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:28.483854 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:28.483854 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:28.483854 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:28.483854 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:28.483854 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:28.483854 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:28.483854 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:28.483854 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:28.483854 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:28.483854 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:39:28.485536 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:39:28.485536 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:28.485536 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:28.485536 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 235/485] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:39:28.485536 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab28b1-e605-4646-ad59-f58533572097 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:28.525325 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:28.532161 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f5e43-099e-4530-9a04-be0a5d621f50 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:28.573890 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e201b31-6ed9-4529-bc74-daa3c9a098d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:28.573890 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e201b31-6ed9-4529-bc74-daa3c9a098d7 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:28.573890 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e201b31-6ed9-4529-bc74-daa3c9a098d7 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:28.573890 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e201b31-6ed9-4529-bc74-daa3c9a098d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:28.585226 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e201b31-6ed9-4529-bc74-daa3c9a098d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:39:28.590427 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-9e201b31-6ed9-4529-bc74-daa3c9a098d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:39:28.590427 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:28.590427 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:28.590427 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:28.590427 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:28.590427 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:28.590427 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:28.590427 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:28.590427 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:28.590427 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:28.590427 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:28.590427 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:28.590427 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:39:28.590427 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:39:28.590427 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:39:28.590427 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:39:28.591525 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:39:28.591525 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:39:28.591525 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:39:28.591525 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:39:28.591525 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:28.591525 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:28.591525 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:28.591525 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:28.591525 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:28.591525 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:28.591525 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:28.591525 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:28.591525 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:28.591525 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:28.591525 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:28.591525 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:28.592332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:28.592332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:28.592332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:28.592332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:28.592332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:39:28.592332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:39:28.592332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:39:28.592332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:39:28.592332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:39:28.592332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:39:28.592332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:39:28.592332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:28.592332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 251/486] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 00:39:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:28.592999 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e201b31-6ed9-4529-bc74-daa3c9a098d7 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:28.610452 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab28b1-e605-4646-ad59-f58533572097 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:28.640631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:28.647268 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9bd293-7477-429e-be92-a169ac7ecfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:28.647268 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9bd293-7477-429e-be92-a169ac7ecfb3 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:28.647268 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9bd293-7477-429e-be92-a169ac7ecfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:28.647608 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9bd293-7477-429e-be92-a169ac7ecfb3 None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:28.648169 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9bd293-7477-429e-be92-a169ac7ecfb3 None admin] RBAC: Adding query filter params (name=service) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:28.648474 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9bd293-7477-429e-be92-a169ac7ecfb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:28.649919 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9bd293-7477-429e-be92-a169ac7ecfb3 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:28.659075 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 236/487] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 00:39:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:28.660332 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c70ef3-6ca7-4709-8f92-99e43898ee06 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:28.660623 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c70ef3-6ca7-4709-8f92-99e43898ee06 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:28.660910 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c70ef3-6ca7-4709-8f92-99e43898ee06 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:28.662199 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 237/488] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:28.662930 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c70ef3-6ca7-4709-8f92-99e43898ee06 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:28.703480 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e201b31-6ed9-4529-bc74-daa3c9a098d7 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:28.739276 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a4c45-9763-40cb-8b39-fe4103fea346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:28.739881 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a4c45-9763-40cb-8b39-fe4103fea346 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:28.740156 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a4c45-9763-40cb-8b39-fe4103fea346 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:28.740612 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a4c45-9763-40cb-8b39-fe4103fea346 None admin] PATH_INFO: `/v3/domains` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:28.741096 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a4c45-9763-40cb-8b39-fe4103fea346 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:28.741421 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a4c45-9763-40cb-8b39-fe4103fea346 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:28.742797 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a4c45-9763-40cb-8b39-fe4103fea346 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:28.755979 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 252/489] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:28.756737 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a4c45-9763-40cb-8b39-fe4103fea346 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:28.775827 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:28.781490 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c70ef3-6ca7-4709-8f92-99e43898ee06 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:28.818929 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b30bb-4797-4a4c-ab9b-01ddce5edaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:28.819547 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b30bb-4797-4a4c-ab9b-01ddce5edaa4 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:28.819837 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b30bb-4797-4a4c-ab9b-01ddce5edaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:28.820115 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b30bb-4797-4a4c-ab9b-01ddce5edaa4 None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:28.820802 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b30bb-4797-4a4c-ab9b-01ddce5edaa4 None admin] RBAC: Adding query filter params (name=service) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:28.821108 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b30bb-4797-4a4c-ab9b-01ddce5edaa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:28.823155 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b30bb-4797-4a4c-ab9b-01ddce5edaa4 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:28.831728 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 238/490] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 00:39:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:28.832938 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b337ee-3132-4242-98e9-5591cfb19ca9 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:28.833219 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b337ee-3132-4242-98e9-5591cfb19ca9 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:28.833526 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b337ee-3132-4242-98e9-5591cfb19ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:28.851423 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-c3b337ee-3132-4242-98e9-5591cfb19ca9 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:28.852659 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-c3b337ee-3132-4242-98e9-5591cfb19ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:28.868116 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a4c45-9763-40cb-8b39-fe4103fea346 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:28.905366 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eec7e9-9030-4c5f-90f0-033b1f3c3c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:28.906070 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eec7e9-9030-4c5f-90f0-033b1f3c3c0b None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:28.906356 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eec7e9-9030-4c5f-90f0-033b1f3c3c0b None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:28.906708 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eec7e9-9030-4c5f-90f0-033b1f3c3c0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:28.909536 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:28.922012 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eec7e9-9030-4c5f-90f0-033b1f3c3c0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:28.923683 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eec7e9-9030-4c5f-90f0-033b1f3c3c0b None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:28.928927 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 239/491] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:39:28.929808 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b337ee-3132-4242-98e9-5591cfb19ca9 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:28.948652 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-e8eec7e9-9030-4c5f-90f0-033b1f3c3c0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:28.948652 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:28.948652 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:28.948652 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:28.948652 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:28.948652 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:28.948652 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:28.948652 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:28.948652 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:28.948652 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:28.948652 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:28.948652 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:28.948652 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:39:28.948652 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:39:28.948652 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:39:28.948652 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:39:28.950591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:28.950591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:28.950591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:28.950591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:28.950591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:28.950591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:28.950591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:28.950591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:28.950591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:28.950591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:28.950591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:28.950591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:28.950591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:28.950591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:28.950591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:28.950591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:28.950591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:39:28.954248 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:39:28.954248 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:28.954248 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:28.954248 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 253/492] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:28.954248 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eec7e9-9030-4c5f-90f0-033b1f3c3c0b None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:29.024672 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:29.066165 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b337ee-3132-4242-98e9-5591cfb19ca9 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:29.067596 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eec7e9-9030-4c5f-90f0-033b1f3c3c0b None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:29.104429 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea9e05-49a8-4d2e-98d9-9a1e37e614f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:29.105534 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea9e05-49a8-4d2e-98d9-9a1e37e614f5 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:29.105884 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea9e05-49a8-4d2e-98d9-9a1e37e614f5 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:29.106165 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea9e05-49a8-4d2e-98d9-9a1e37e614f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:29.106804 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f021d-72d7-4660-9a59-0f7f1e41e0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:29.107783 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f021d-72d7-4660-9a59-0f7f1e41e0b3 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:29.108101 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f021d-72d7-4660-9a59-0f7f1e41e0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:29.108378 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f021d-72d7-4660-9a59-0f7f1e41e0b3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:29.116473 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f021d-72d7-4660-9a59-0f7f1e41e0b3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:29.117991 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f021d-72d7-4660-9a59-0f7f1e41e0b3 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:29.122499 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea9e05-49a8-4d2e-98d9-9a1e37e614f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:29.123956 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea9e05-49a8-4d2e-98d9-9a1e37e614f5 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:29.134758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-ca7f021d-72d7-4660-9a59-0f7f1e41e0b3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:39:29.134758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:29.134758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:29.134758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:29.134758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:29.134758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:29.134758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:29.134758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:29.134758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:29.134758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:29.134758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:29.134758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:29.134758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:39:29.134758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:39:29.134758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:39:29.134758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:39:29.136034 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:29.136034 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:29.136034 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:39:29.136034 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:39:29.136034 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:39:29.136034 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:39:29.136034 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:29.136034 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:29.136034 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:29.136034 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:29.136034 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:29.136034 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:29.136034 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:29.136034 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:29.136034 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:29.136034 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:29.136034 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:29.136034 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:29.136941 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:29.136941 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:29.136941 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:39:29.136941 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:39:29.136941 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:39:29.136941 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:39:29.136941 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:39:29.136941 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:39:29.136941 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:39:29.136941 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:29.138944 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 240/493] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Aug 26 00:39:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:29.139792 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-c7ea9e05-49a8-4d2e-98d9-9a1e37e614f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:29.139792 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:29.139792 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:29.139792 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:29.139792 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:29.139792 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:29.139792 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:29.139792 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:29.139792 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:29.139792 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:29.139792 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:29.139792 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:29.139792 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:39:29.139792 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:39:29.139792 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:39:29.139792 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:39:29.140692 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:29.140692 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:29.140692 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:29.140692 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:29.140692 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:29.140692 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:29.140692 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:29.140692 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:29.140692 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:29.140692 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:29.140692 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:29.140692 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:29.140692 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:29.140692 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:29.140692 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:29.140692 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:29.140692 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:39:29.141616 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:39:29.141616 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:29.141616 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:29.141616 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 254/494] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:29.141941 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f021d-72d7-4660-9a59-0f7f1e41e0b3 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:29.145272 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea9e05-49a8-4d2e-98d9-9a1e37e614f5 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:29.271022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:29.292980 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea9e05-49a8-4d2e-98d9-9a1e37e614f5 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:29.313528 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:29.327203 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f021d-72d7-4660-9a59-0f7f1e41e0b3 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:29.327836 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423f4e7-c2c2-42b4-ab7b-5747d30e007b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:29.328439 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423f4e7-c2c2-42b4-ab7b-5747d30e007b None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:29.328716 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423f4e7-c2c2-42b4-ab7b-5747d30e007b None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:29.328987 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423f4e7-c2c2-42b4-ab7b-5747d30e007b None admin] PATH_INFO: `/v3/users` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:29.329752 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423f4e7-c2c2-42b4-ab7b-5747d30e007b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:29.330057 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423f4e7-c2c2-42b4-ab7b-5747d30e007b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:29.331495 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423f4e7-c2c2-42b4-ab7b-5747d30e007b None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:29.365500 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef6a04-36c9-4e98-a344-507321045f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:29.366121 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef6a04-36c9-4e98-a344-507321045f25 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:29.366404 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef6a04-36c9-4e98-a344-507321045f25 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:29.366679 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef6a04-36c9-4e98-a344-507321045f25 None admin] PATH_INFO: `/v3/domains` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:29.367340 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef6a04-36c9-4e98-a344-507321045f25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:29.367648 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef6a04-36c9-4e98-a344-507321045f25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:29.369112 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef6a04-36c9-4e98-a344-507321045f25 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:29.377815 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 255/495] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Aug 26 00:39:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:29.378704 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423f4e7-c2c2-42b4-ab7b-5747d30e007b None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:29.384255 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 241/496] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:29.385270 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef6a04-36c9-4e98-a344-507321045f25 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:29.494822 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef6a04-36c9-4e98-a344-507321045f25 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:29.497571 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:29.498257 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423f4e7-c2c2-42b4-ab7b-5747d30e007b None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:29.530949 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d8bde-4355-4750-984c-8e802f43a1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:29.531503 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d8bde-4355-4750-984c-8e802f43a1c1 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:29.531819 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d8bde-4355-4750-984c-8e802f43a1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:29.532096 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d8bde-4355-4750-984c-8e802f43a1c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:29.533788 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0424f-712c-4a23-ac43-a32f00a0393d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:29.534395 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0424f-712c-4a23-ac43-a32f00a0393d None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:29.534677 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0424f-712c-4a23-ac43-a32f00a0393d None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:29.534949 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0424f-712c-4a23-ac43-a32f00a0393d None admin] PATH_INFO: `/v3/domains` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:29.535598 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd0424f-712c-4a23-ac43-a32f00a0393d None admin] RBAC: Adding query filter params (name=Default) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:29.535906 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd0424f-712c-4a23-ac43-a32f00a0393d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:29.537304 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd0424f-712c-4a23-ac43-a32f00a0393d None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:29.544011 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d8bde-4355-4750-984c-8e802f43a1c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:39:29.548858 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-520d8bde-4355-4750-984c-8e802f43a1c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:39:29.548858 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:29.548858 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:29.548858 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:29.548858 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:29.548858 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:29.548858 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:29.548858 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:29.548858 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:29.548858 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:29.548858 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:29.548858 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:29.548858 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:39:29.548858 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:39:29.548858 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:39:29.548858 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:39:29.550186 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:39:29.550186 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:39:29.550186 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:39:29.550186 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:39:29.550186 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:29.550186 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:29.550186 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:29.550186 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:29.550186 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:29.550186 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:29.550186 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:29.550186 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:29.550186 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:29.550186 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:29.550186 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:29.550186 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:29.551059 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:29.551059 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:29.551059 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:29.551059 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:29.551059 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:39:29.551059 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:39:29.551059 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:39:29.551059 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:39:29.551059 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:39:29.551059 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:39:29.551059 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:39:29.551059 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:29.551912 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 256/497] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:29.551912 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0424f-712c-4a23-ac43-a32f00a0393d None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:29.553690 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 242/498] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 00:39:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:29.554807 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d8bde-4355-4750-984c-8e802f43a1c1 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:29.594713 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:29.658611 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0424f-712c-4a23-ac43-a32f00a0393d None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:29.658857 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d8bde-4355-4750-984c-8e802f43a1c1 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:29.693864 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b0d7e-a40e-4778-8307-d493da1d8a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:29.694291 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af6b1a-5317-41c9-b060-f9465f3375f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:29.694472 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b0d7e-a40e-4778-8307-d493da1d8a83 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:29.694752 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b0d7e-a40e-4778-8307-d493da1d8a83 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:29.695019 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af6b1a-5317-41c9-b060-f9465f3375f2 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:29.695109 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b0d7e-a40e-4778-8307-d493da1d8a83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:29.695367 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af6b1a-5317-41c9-b060-f9465f3375f2 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:29.695658 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af6b1a-5317-41c9-b060-f9465f3375f2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:29.704063 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af6b1a-5317-41c9-b060-f9465f3375f2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:29.705562 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af6b1a-5317-41c9-b060-f9465f3375f2 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:29.717467 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-74af6b1a-5317-41c9-b060-f9465f3375f2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 00:39:29.717467 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:29.717467 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:29.717467 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:29.717467 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:29.717467 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:29.717467 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:29.717467 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:29.717467 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:29.717467 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:29.717467 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:29.717467 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:29.717467 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:39:29.717467 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:39:29.717467 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:39:29.717467 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:39:29.718609 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:29.718609 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:29.718609 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:39:29.718609 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:39:29.718609 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:39:29.718609 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:39:29.718609 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:29.718609 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:29.718609 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:29.718609 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:29.718609 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:29.718609 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:29.718609 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:29.718609 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:29.718609 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:29.718609 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:29.718609 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:29.718609 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:29.719498 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:29.719498 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:29.719498 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:39:29.719498 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:39:29.719498 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:39:29.719498 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:39:29.719498 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:39:29.719498 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:39:29.719498 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 00:39:29.719498 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:29.719498 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 243/499] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 00:39:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:29.720058 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af6b1a-5317-41c9-b060-f9465f3375f2 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:29.746597 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:29.770116 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b0d7e-a40e-4778-8307-d493da1d8a83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:29.771651 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b0d7e-a40e-4778-8307-d493da1d8a83 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:29.817768 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:29.827029 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af6b1a-5317-41c9-b060-f9465f3375f2 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:29.863406 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78d048-5d29-4e4e-814d-c045212f2661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:29.864048 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78d048-5d29-4e4e-814d-c045212f2661 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:29.864366 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78d048-5d29-4e4e-814d-c045212f2661 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:29.864604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78d048-5d29-4e4e-814d-c045212f2661 None admin] PATH_INFO: `/v3/users/glance` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:29.873275 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78d048-5d29-4e4e-814d-c045212f2661 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:29.874808 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78d048-5d29-4e4e-814d-c045212f2661 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:29.881380 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 257/500] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:39:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:39:29.882379 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b0d7e-a40e-4778-8307-d493da1d8a83 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:29.887494 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-bb78d048-5d29-4e4e-814d-c045212f2661 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 26 00:39:29.887494 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:29.887494 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:29.887494 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:29.887494 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:29.887494 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:29.887494 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:29.887494 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:29.887494 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:29.887494 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:29.887494 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:29.887494 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:29.887494 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:39:29.887494 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:39:29.887494 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:39:29.887494 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:39:29.888571 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:29.888571 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:29.888571 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:39:29.888571 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:39:29.888571 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:39:29.888571 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:39:29.888571 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:29.888571 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:29.888571 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:29.888571 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:29.888571 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:29.888571 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:29.888571 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:29.888571 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:29.888571 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:29.888571 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:29.888571 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:29.888571 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:29.889652 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:29.889652 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:29.889652 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:39:29.889652 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:39:29.889652 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:39:29.889652 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:39:29.889652 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:39:29.889652 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:39:29.889652 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 26 00:39:29.889652 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:29.889652 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 244/501] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:39:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:29.889652 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78d048-5d29-4e4e-814d-c045212f2661 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:29.980749 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:29.998228 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78d048-5d29-4e4e-814d-c045212f2661 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:30.002449 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b0d7e-a40e-4778-8307-d493da1d8a83 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:30.042616 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97d2a8-9bde-47b6-a63f-4608c0de22ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:30.043579 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97d2a8-9bde-47b6-a63f-4608c0de22ba None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:30.043997 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97d2a8-9bde-47b6-a63f-4608c0de22ba None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:30.044446 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97d2a8-9bde-47b6-a63f-4608c0de22ba None admin] PATH_INFO: `/v3/users` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:30.045681 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97d2a8-9bde-47b6-a63f-4608c0de22ba None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:30.046189 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97d2a8-9bde-47b6-a63f-4608c0de22ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:30.048617 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97d2a8-9bde-47b6-a63f-4608c0de22ba None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:30.058135 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145468a-48f3-4f9d-b71a-d14ea0bd18b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:30.058759 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145468a-48f3-4f9d-b71a-d14ea0bd18b9 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:30.059039 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145468a-48f3-4f9d-b71a-d14ea0bd18b9 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:30.059318 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145468a-48f3-4f9d-b71a-d14ea0bd18b9 None admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:30.060070 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145468a-48f3-4f9d-b71a-d14ea0bd18b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:30.060314 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145468a-48f3-4f9d-b71a-d14ea0bd18b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:30.061798 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145468a-48f3-4f9d-b71a-d14ea0bd18b9 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:30.067599 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:30.070967 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 258/502] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 00:39:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:30.071716 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145468a-48f3-4f9d-b71a-d14ea0bd18b9 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:30.089746 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 245/503] 10.222.0.20 () {56 vars in 1139 bytes} [Fri Aug 26 00:39:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:30.090703 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97d2a8-9bde-47b6-a63f-4608c0de22ba None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:30.179279 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145468a-48f3-4f9d-b71a-d14ea0bd18b9 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:30.196260 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97d2a8-9bde-47b6-a63f-4608c0de22ba None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:30.218317 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2dac85-7729-4e35-b5ea-607f8de0b5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:30.218958 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2dac85-7729-4e35-b5ea-607f8de0b5a4 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:30.219235 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2dac85-7729-4e35-b5ea-607f8de0b5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:30.219507 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2dac85-7729-4e35-b5ea-607f8de0b5a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:30.232299 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2dac85-7729-4e35-b5ea-607f8de0b5a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:30.233821 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2dac85-7729-4e35-b5ea-607f8de0b5a4 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:30.234380 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f03b1e-04ac-450c-b6f1-e4396cddf03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:30.235022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f03b1e-04ac-450c-b6f1-e4396cddf03f None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:30.235302 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f03b1e-04ac-450c-b6f1-e4396cddf03f None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:30.235582 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f03b1e-04ac-450c-b6f1-e4396cddf03f None admin] PATH_INFO: `/v3/users` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:30.236356 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f03b1e-04ac-450c-b6f1-e4396cddf03f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:30.236668 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f03b1e-04ac-450c-b6f1-e4396cddf03f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:30.238260 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f03b1e-04ac-450c-b6f1-e4396cddf03f None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:30.254047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-6c2dac85-7729-4e35-b5ea-607f8de0b5a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:30.254047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:30.254047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:30.254047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:30.254047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:30.254047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:30.254047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:30.254047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:30.254047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:30.254047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:30.254047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:30.254047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:30.254047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:39:30.254047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:39:30.254047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:39:30.254047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:39:30.255168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:30.255168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:30.255168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:30.255168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:30.255168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:30.255168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:30.255168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:30.255168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:30.255168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:30.255168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:30.255168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:30.255168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:30.255168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:30.255168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:30.255168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:30.255168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:30.255168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:39:30.256156 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:39:30.256156 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:30.256156 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:30.256156 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 259/504] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:30.256598 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2dac85-7729-4e35-b5ea-607f8de0b5a4 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:30.257526 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:30.260963 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 246/505] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Aug 26 00:39:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:30.261927 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f03b1e-04ac-450c-b6f1-e4396cddf03f None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:30.317269 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:30.366506 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2dac85-7729-4e35-b5ea-607f8de0b5a4 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:30.371188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f03b1e-04ac-450c-b6f1-e4396cddf03f None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:30.403240 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83859aa8-3619-48e1-bb89-2f36b1e3e121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:30.403881 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83859aa8-3619-48e1-bb89-2f36b1e3e121 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:30.404161 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83859aa8-3619-48e1-bb89-2f36b1e3e121 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:30.404434 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83859aa8-3619-48e1-bb89-2f36b1e3e121 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:30.406621 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aab455-8906-4141-a7cb-a977dddb754d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:30.407222 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aab455-8906-4141-a7cb-a977dddb754d None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:30.407500 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aab455-8906-4141-a7cb-a977dddb754d None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:30.407770 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aab455-8906-4141-a7cb-a977dddb754d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:30.415363 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83859aa8-3619-48e1-bb89-2f36b1e3e121 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:30.417327 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83859aa8-3619-48e1-bb89-2f36b1e3e121 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:30.433155 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-83859aa8-3619-48e1-bb89-2f36b1e3e121 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:30.433155 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:30.433155 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:30.433155 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:30.433155 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:30.433155 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:30.433155 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:30.433155 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:30.433155 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:30.433155 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:30.433155 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:30.433155 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:30.433155 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:39:30.433155 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:39:30.433155 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:39:30.433155 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:39:30.434332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:30.434332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:30.434332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:30.434332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:30.434332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:30.434332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:30.434332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:30.434332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:30.434332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:30.434332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:30.434332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:30.434332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:30.434332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:30.434332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:30.434332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:30.434332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:30.434332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:39:30.435454 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:39:30.435454 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:30.435454 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:30.435454 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 260/506] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:30.435454 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83859aa8-3619-48e1-bb89-2f36b1e3e121 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:30.480009 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:30.482559 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aab455-8906-4141-a7cb-a977dddb754d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:30.484068 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aab455-8906-4141-a7cb-a977dddb754d None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:30.541289 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83859aa8-3619-48e1-bb89-2f36b1e3e121 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:30.543743 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:30.577102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd98d36-9426-480d-a0b4-d55addb94835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:30.577741 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd98d36-9426-480d-a0b4-d55addb94835 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:30.578026 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd98d36-9426-480d-a0b4-d55addb94835 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:30.578303 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd98d36-9426-480d-a0b4-d55addb94835 None admin] PATH_INFO: `/v3/domains` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:30.578952 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd98d36-9426-480d-a0b4-d55addb94835 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:30.579261 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd98d36-9426-480d-a0b4-d55addb94835 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:30.580686 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd98d36-9426-480d-a0b4-d55addb94835 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:30.594183 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 247/507] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:39:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:39:30.595057 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aab455-8906-4141-a7cb-a977dddb754d None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:30.595239 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 261/508] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:30.596089 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd98d36-9426-480d-a0b4-d55addb94835 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:30.700934 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:30.703992 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aab455-8906-4141-a7cb-a977dddb754d None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:30.706541 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd98d36-9426-480d-a0b4-d55addb94835 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:30.740287 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b12651-d1bf-4775-b3d3-3185cd37a553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:30.740892 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b12651-d1bf-4775-b3d3-3185cd37a553 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:30.741170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b12651-d1bf-4775-b3d3-3185cd37a553 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:30.741490 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b12651-d1bf-4775-b3d3-3185cd37a553 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:30.743276 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec4911-f416-48be-ab6b-7a25f45a4594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:30.744479 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec4911-f416-48be-ab6b-7a25f45a4594 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:30.744698 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec4911-f416-48be-ab6b-7a25f45a4594 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:30.744972 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec4911-f416-48be-ab6b-7a25f45a4594 None admin] PATH_INFO: `/v3/domains` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:30.745661 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec4911-f416-48be-ab6b-7a25f45a4594 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:30.746368 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec4911-f416-48be-ab6b-7a25f45a4594 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:30.747483 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec4911-f416-48be-ab6b-7a25f45a4594 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:30.760570 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 262/509] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:30.761926 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec4911-f416-48be-ab6b-7a25f45a4594 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:30.788361 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:30.823758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b12651-d1bf-4775-b3d3-3185cd37a553 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:30.825239 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b12651-d1bf-4775-b3d3-3185cd37a553 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:30.866436 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec4911-f416-48be-ab6b-7a25f45a4594 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:30.903105 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05dadb-e2e9-4043-9b30-5ec21c43626b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:30.903834 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05dadb-e2e9-4043-9b30-5ec21c43626b None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:30.904016 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05dadb-e2e9-4043-9b30-5ec21c43626b None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:30.904300 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05dadb-e2e9-4043-9b30-5ec21c43626b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:30.919898 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05dadb-e2e9-4043-9b30-5ec21c43626b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:30.921397 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05dadb-e2e9-4043-9b30-5ec21c43626b None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:30.937548 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-3a05dadb-e2e9-4043-9b30-5ec21c43626b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:30.937548 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:30.937548 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:30.937548 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:30.937548 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:30.937548 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:30.937548 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:30.937548 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:30.937548 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:30.937548 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:30.937548 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:30.937548 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:30.937548 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:39:30.937548 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:39:30.937548 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:39:30.937548 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:39:30.938669 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:30.938669 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:30.938669 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:30.938669 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:30.938669 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:30.938669 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:30.938669 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:30.938669 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:30.938669 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:30.938669 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:30.938669 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:30.938669 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:30.938669 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:30.938669 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:30.938669 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:30.938669 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:30.938669 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:39:30.939717 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:39:30.939717 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:30.939717 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:30.939913 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:30.939995 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 263/510] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:30.939995 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05dadb-e2e9-4043-9b30-5ec21c43626b None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:30.943645 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 248/511] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:39:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:39:30.943899 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b12651-d1bf-4775-b3d3-3185cd37a553 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:31.028632 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:31.049418 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b12651-d1bf-4775-b3d3-3185cd37a553 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:31.052483 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05dadb-e2e9-4043-9b30-5ec21c43626b None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:31.086272 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579cc10d-5487-4ff8-abd6-2a103e5785dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:31.086914 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cc10d-5487-4ff8-abd6-2a103e5785dc None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:31.087274 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cc10d-5487-4ff8-abd6-2a103e5785dc None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:31.087550 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cc10d-5487-4ff8-abd6-2a103e5785dc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:31.090057 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850a42c-8416-44e3-988d-1d1eeed846b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:31.090057 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850a42c-8416-44e3-988d-1d1eeed846b7 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:31.090265 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850a42c-8416-44e3-988d-1d1eeed846b7 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:31.090422 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850a42c-8416-44e3-988d-1d1eeed846b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:31.095969 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579cc10d-5487-4ff8-abd6-2a103e5785dc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:31.097298 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579cc10d-5487-4ff8-abd6-2a103e5785dc None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:31.097829 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850a42c-8416-44e3-988d-1d1eeed846b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:31.099275 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850a42c-8416-44e3-988d-1d1eeed846b7 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:31.111698 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-579cc10d-5487-4ff8-abd6-2a103e5785dc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 00:39:31.111698 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:31.111698 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:31.111698 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:31.111698 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:31.111698 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:31.111698 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:31.111698 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:31.111698 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:31.111698 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:31.111698 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:31.111698 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:31.111698 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:39:31.111698 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:39:31.111698 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:39:31.111698 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:39:31.112762 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:31.112762 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:31.112762 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:39:31.112762 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:39:31.112762 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:39:31.112762 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:39:31.112762 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:31.112762 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:31.112762 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:31.112762 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:31.112762 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:31.112762 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:31.112762 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:31.112762 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:31.112762 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:31.112762 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:31.112762 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:31.112762 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:31.114897 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:31.114897 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:31.114897 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:39:31.114897 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:39:31.114897 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:39:31.114897 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:39:31.114897 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:39:31.114897 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:39:31.114897 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 00:39:31.114897 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:31.115989 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-9850a42c-8416-44e3-988d-1d1eeed846b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:39:31.115989 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:31.115989 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:31.115989 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:31.115989 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:31.115989 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:31.115989 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:31.115989 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:31.115989 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:31.115989 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:31.115989 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:31.115989 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:31.115989 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:39:31.115989 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:39:31.115989 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:39:31.118306 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:39:31.118306 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:31.118306 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:31.118306 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:31.118306 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:31.118306 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:31.118306 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:31.118306 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:31.118306 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:31.118306 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:31.118306 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:31.118306 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:31.118306 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:31.118306 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:31.118306 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:31.118306 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:31.118306 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:31.121032 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:39:31.121032 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:39:31.121032 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:39:31.121032 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:39:31.121032 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:39:31.121032 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:39:31.121032 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:39:31.121032 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:31.122041 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 249/512] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:39:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:31.122041 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579cc10d-5487-4ff8-abd6-2a103e5785dc None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:31.122304 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 264/513] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:39:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:31.122304 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850a42c-8416-44e3-988d-1d1eeed846b7 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:31.186472 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:31.236156 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579cc10d-5487-4ff8-abd6-2a103e5785dc None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:31.236809 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850a42c-8416-44e3-988d-1d1eeed846b7 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:31.273767 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9682ef-17c6-4986-831a-aee8a99bd618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:31.274024 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386ef11-773a-4fdd-b69d-da903710b2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:31.274384 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386ef11-773a-4fdd-b69d-da903710b2cb None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:31.274482 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9682ef-17c6-4986-831a-aee8a99bd618 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:31.274661 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9682ef-17c6-4986-831a-aee8a99bd618 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:31.274748 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386ef11-773a-4fdd-b69d-da903710b2cb None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:31.274932 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9682ef-17c6-4986-831a-aee8a99bd618 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:31.275022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386ef11-773a-4fdd-b69d-da903710b2cb None admin] PATH_INFO: `/v3/domains` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:31.275944 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386ef11-773a-4fdd-b69d-da903710b2cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:31.276257 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386ef11-773a-4fdd-b69d-da903710b2cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:31.277694 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386ef11-773a-4fdd-b69d-da903710b2cb None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:31.278718 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:31.287452 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9682ef-17c6-4986-831a-aee8a99bd618 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:31.288914 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9682ef-17c6-4986-831a-aee8a99bd618 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:31.290290 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 250/514] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:31.291741 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386ef11-773a-4fdd-b69d-da903710b2cb None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:31.305321 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-ac9682ef-17c6-4986-831a-aee8a99bd618 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:31.305321 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:31.305321 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:31.305321 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:31.305321 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:31.305321 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:31.305321 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:31.305321 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:31.305321 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:31.305321 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:31.305321 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:31.305321 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:31.305321 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:39:31.305321 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:39:31.305321 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:39:31.305321 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:39:31.307137 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:31.307137 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:31.307137 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:31.307137 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:31.307137 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:31.307137 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:31.307137 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:31.307137 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:31.307137 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:31.307137 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:31.307137 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:31.307137 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:31.307137 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:31.307137 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:31.307137 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:31.307137 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:31.307137 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:39:31.308372 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:39:31.308372 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:31.308372 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:31.308372 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 265/515] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:31.308762 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9682ef-17c6-4986-831a-aee8a99bd618 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:31.406440 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386ef11-773a-4fdd-b69d-da903710b2cb None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:31.416276 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9682ef-17c6-4986-831a-aee8a99bd618 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:31.427704 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:31.442174 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52b05c-caf3-4117-ac20-da2c6885a6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:31.442793 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52b05c-caf3-4117-ac20-da2c6885a6ab None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:31.443071 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52b05c-caf3-4117-ac20-da2c6885a6ab None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:31.443350 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52b05c-caf3-4117-ac20-da2c6885a6ab None admin] PATH_INFO: `/v3/users` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:31.444097 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52b05c-caf3-4117-ac20-da2c6885a6ab None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:31.444405 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52b05c-caf3-4117-ac20-da2c6885a6ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:31.445964 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52b05c-caf3-4117-ac20-da2c6885a6ab None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:31.452737 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff85ff9-95d8-4544-abe1-d87ea197a64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:31.453341 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff85ff9-95d8-4544-abe1-d87ea197a64c None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:31.453652 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff85ff9-95d8-4544-abe1-d87ea197a64c None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:31.453931 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff85ff9-95d8-4544-abe1-d87ea197a64c None admin] PATH_INFO: `/v3/projects` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:31.454614 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff85ff9-95d8-4544-abe1-d87ea197a64c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:31.454919 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff85ff9-95d8-4544-abe1-d87ea197a64c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:31.456351 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff85ff9-95d8-4544-abe1-d87ea197a64c None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:31.464239 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 251/516] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Aug 26 00:39:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:31.465066 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52b05c-caf3-4117-ac20-da2c6885a6ab None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:31.475534 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 266/517] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 00:39:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:31.476380 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff85ff9-95d8-4544-abe1-d87ea197a64c None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:31.532922 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:31.580119 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52b05c-caf3-4117-ac20-da2c6885a6ab None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:31.584673 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff85ff9-95d8-4544-abe1-d87ea197a64c None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:31.615332 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a009c1-52bc-41fc-8f1a-3758cfca2cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:31.615980 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a009c1-52bc-41fc-8f1a-3758cfca2cf5 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:31.616261 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a009c1-52bc-41fc-8f1a-3758cfca2cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:31.616537 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a009c1-52bc-41fc-8f1a-3758cfca2cf5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:31.619814 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0821b-d279-4a03-8644-e2803af4bfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:31.620407 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0821b-d279-4a03-8644-e2803af4bfc7 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:31.620684 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0821b-d279-4a03-8644-e2803af4bfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:31.620957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0821b-d279-4a03-8644-e2803af4bfc7 None admin] PATH_INFO: `/v3/domains` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:31.621632 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0821b-d279-4a03-8644-e2803af4bfc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:31.621931 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0821b-d279-4a03-8644-e2803af4bfc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:31.623303 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0821b-d279-4a03-8644-e2803af4bfc7 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:31.623653 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a009c1-52bc-41fc-8f1a-3758cfca2cf5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:31.625094 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a009c1-52bc-41fc-8f1a-3758cfca2cf5 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:31.634701 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 267/518] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:31.639517 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0821b-d279-4a03-8644-e2803af4bfc7 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:31.639661 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-05a009c1-52bc-41fc-8f1a-3758cfca2cf5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:39:31.639661 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:31.639661 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:31.639661 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:31.639661 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:31.639661 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:31.639661 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:31.639661 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:31.639661 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:31.639661 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:31.639661 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:31.639661 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:31.639661 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:39:31.639661 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:39:31.639661 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:39:31.640457 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:39:31.640457 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:31.640457 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:31.640457 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:31.640457 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:31.640457 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:31.640457 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:31.640457 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:31.640457 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:31.640457 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:31.640457 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:31.640457 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:31.640457 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:31.640457 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:31.640457 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:31.640457 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:31.640457 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:31.641295 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:39:31.641295 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:39:31.641295 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:39:31.641295 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:39:31.641295 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:39:31.641295 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:39:31.641295 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:39:31.641295 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:31.641295 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 252/519] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:39:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:31.641295 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a009c1-52bc-41fc-8f1a-3758cfca2cf5 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:31.685026 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:31.748995 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a009c1-52bc-41fc-8f1a-3758cfca2cf5 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:31.762972 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0821b-d279-4a03-8644-e2803af4bfc7 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:31.772870 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:31.798681 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9fcc54-93f7-4664-b32c-911c0e3f1481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:31.798681 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fcc54-93f7-4664-b32c-911c0e3f1481 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:31.798681 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fcc54-93f7-4664-b32c-911c0e3f1481 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:31.798681 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fcc54-93f7-4664-b32c-911c0e3f1481 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:31.799103 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9fcc54-93f7-4664-b32c-911c0e3f1481 None admin] RBAC: Adding query filter params (role.id=e6933171244b410694fbc4f1d8cb0130, scope.project.id=fe7cc05cd9f44d74a635079ef883d9a9, user.id=02f74984033043ecabd28df33960a37c) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:31.799103 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9fcc54-93f7-4664-b32c-911c0e3f1481 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:31.799103 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9fcc54-93f7-4664-b32c-911c0e3f1481 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:31.799103 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 253/520] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 00:39:31 2022] GET /identity/v3/role_assignments?user.id=02f74984033043ecabd28df33960a37c&scope.project.id=fe7cc05cd9f44d74a635079ef883d9a9&role.id=e6933171244b410694fbc4f1d8cb0130 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:31.799103 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9fcc54-93f7-4664-b32c-911c0e3f1481 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:31.805696 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4f4bc-c861-401f-8afe-fc44cd0ee859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:31.806338 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4f4bc-c861-401f-8afe-fc44cd0ee859 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:31.806886 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4f4bc-c861-401f-8afe-fc44cd0ee859 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:31.807168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4f4bc-c861-401f-8afe-fc44cd0ee859 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:31.898108 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4f4bc-c861-401f-8afe-fc44cd0ee859 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:31.899788 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4f4bc-c861-401f-8afe-fc44cd0ee859 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:31.937053 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9fcc54-93f7-4664-b32c-911c0e3f1481 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:31.939458 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:31.985087 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe97df-6f2c-469d-9192-0d0ffed9dd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:31.986394 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe97df-6f2c-469d-9192-0d0ffed9dd5e None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:31.986753 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe97df-6f2c-469d-9192-0d0ffed9dd5e None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:31.986950 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe97df-6f2c-469d-9192-0d0ffed9dd5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:31.995392 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe97df-6f2c-469d-9192-0d0ffed9dd5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:31.996899 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe97df-6f2c-469d-9192-0d0ffed9dd5e None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:32.009893 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-cafe97df-6f2c-469d-9192-0d0ffed9dd5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:39:32.009893 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:32.009893 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:32.009893 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:32.009893 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:32.009893 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:32.009893 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:32.009893 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:32.009893 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:32.009893 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:32.009893 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:32.009893 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:32.009893 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:39:32.009893 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:39:32.009893 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:39:32.015872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:39:32.015872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:32.015872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:32.015872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:32.015872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:32.015872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:32.015872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:32.015872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:32.015872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:32.015872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:32.015872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:32.015872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:32.015872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:32.015872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:32.015872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:32.015872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:32.015872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:32.017072 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:39:32.017072 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:39:32.017072 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:39:32.017072 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:39:32.017072 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:39:32.017072 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:39:32.017072 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:39:32.017072 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:32.017072 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 254/521] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:39:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:32.017072 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe97df-6f2c-469d-9192-0d0ffed9dd5e None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:32.051192 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 268/522] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:39:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:39:32.051192 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4f4bc-c861-401f-8afe-fc44cd0ee859 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:32.062809 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:32.139301 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe97df-6f2c-469d-9192-0d0ffed9dd5e None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:32.177457 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998b81c-ece2-4e1c-a1c6-1fe46ea72c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:32.178091 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998b81c-ece2-4e1c-a1c6-1fe46ea72c16 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:32.178375 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998b81c-ece2-4e1c-a1c6-1fe46ea72c16 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:32.178656 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998b81c-ece2-4e1c-a1c6-1fe46ea72c16 None admin] PATH_INFO: `/v3/projects` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:32.179373 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998b81c-ece2-4e1c-a1c6-1fe46ea72c16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:32.179690 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998b81c-ece2-4e1c-a1c6-1fe46ea72c16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:32.181171 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998b81c-ece2-4e1c-a1c6-1fe46ea72c16 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:32.181296 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4f4bc-c861-401f-8afe-fc44cd0ee859 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:32.200743 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 255/523] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 00:39:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:32.201968 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998b81c-ece2-4e1c-a1c6-1fe46ea72c16 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:32.226769 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e21b8d-950f-42d1-bf78-1a3e126bb51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:32.227386 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e21b8d-950f-42d1-bf78-1a3e126bb51b None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:32.227669 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e21b8d-950f-42d1-bf78-1a3e126bb51b None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:32.228036 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e21b8d-950f-42d1-bf78-1a3e126bb51b None admin] PATH_INFO: `/v3/projects` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:32.229570 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e21b8d-950f-42d1-bf78-1a3e126bb51b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:32.229890 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e21b8d-950f-42d1-bf78-1a3e126bb51b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:32.230482 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:32.232192 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e21b8d-950f-42d1-bf78-1a3e126bb51b None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:32.250741 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 269/524] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 00:39:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:32.250741 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e21b8d-950f-42d1-bf78-1a3e126bb51b None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:32.325618 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998b81c-ece2-4e1c-a1c6-1fe46ea72c16 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:32.332063 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:32.370580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d80b13-070e-4f53-8c1d-ad3317300b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:32.371237 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e21b8d-950f-42d1-bf78-1a3e126bb51b None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:32.371351 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d80b13-070e-4f53-8c1d-ad3317300b44 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:32.371536 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d80b13-070e-4f53-8c1d-ad3317300b44 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:32.371812 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d80b13-070e-4f53-8c1d-ad3317300b44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:32.383498 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d80b13-070e-4f53-8c1d-ad3317300b44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:32.385984 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d80b13-070e-4f53-8c1d-ad3317300b44 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:32.404022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-f4d80b13-070e-4f53-8c1d-ad3317300b44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:32.404022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:32.404022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:32.404022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:32.404022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:32.404022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:32.404022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:32.404022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:32.404022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:32.404022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:32.404022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:32.404022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:32.404022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:39:32.404022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:39:32.404022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:39:32.404022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:39:32.405188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:32.405188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:32.405188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:32.405188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:32.405188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:32.405188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:32.405188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:32.405188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:32.405188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:32.405188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:32.405188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:32.405188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:32.405188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:32.405188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:32.405188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:32.405188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:32.405188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:39:32.406119 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:39:32.406119 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:32.406119 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:32.406119 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 256/525] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:32.406654 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d80b13-070e-4f53-8c1d-ad3317300b44 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:32.422005 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99baa7-74b2-4683-801c-fda3295185f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:32.422622 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99baa7-74b2-4683-801c-fda3295185f3 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:32.422909 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99baa7-74b2-4683-801c-fda3295185f3 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:32.423183 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99baa7-74b2-4683-801c-fda3295185f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:32.423924 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99baa7-74b2-4683-801c-fda3295185f3 None admin] RBAC: Adding query filter params (role.id=e6933171244b410694fbc4f1d8cb0130, scope.project.id=fe7cc05cd9f44d74a635079ef883d9a9, user.id=fd3d4bf8049a44749b6be1d565303176) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:32.424242 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99baa7-74b2-4683-801c-fda3295185f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:32.426018 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99baa7-74b2-4683-801c-fda3295185f3 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:32.433028 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 270/526] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 00:39:32 2022] GET /identity/v3/role_assignments?user.id=fd3d4bf8049a44749b6be1d565303176&scope.project.id=fe7cc05cd9f44d74a635079ef883d9a9&role.id=e6933171244b410694fbc4f1d8cb0130 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:32.437404 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99baa7-74b2-4683-801c-fda3295185f3 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:32.527224 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:32.572950 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d80b13-070e-4f53-8c1d-ad3317300b44 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:32.608797 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99baa7-74b2-4683-801c-fda3295185f3 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:32.641499 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1176eee-563e-4a93-8098-57552bbc91b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:32.642192 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1176eee-563e-4a93-8098-57552bbc91b5 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:32.642549 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1176eee-563e-4a93-8098-57552bbc91b5 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:32.642746 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1176eee-563e-4a93-8098-57552bbc91b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:32.643483 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1176eee-563e-4a93-8098-57552bbc91b5 None admin] RBAC: Adding query filter params (role.id=e6933171244b410694fbc4f1d8cb0130, scope.project.id=fe7cc05cd9f44d74a635079ef883d9a9, user.id=930b863db5db4586be6176c18a3bafd5) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:32.643795 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1176eee-563e-4a93-8098-57552bbc91b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:32.645687 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1176eee-563e-4a93-8098-57552bbc91b5 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:32.648526 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:32.653987 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 257/527] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 00:39:32 2022] GET /identity/v3/role_assignments?user.id=930b863db5db4586be6176c18a3bafd5&scope.project.id=fe7cc05cd9f44d74a635079ef883d9a9&role.id=e6933171244b410694fbc4f1d8cb0130 => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:32.655404 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d29a87-9d10-4c4a-8ed4-93cfbd816aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:32.656162 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d29a87-9d10-4c4a-8ed4-93cfbd816aad None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:32.656552 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d29a87-9d10-4c4a-8ed4-93cfbd816aad None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:32.656934 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d29a87-9d10-4c4a-8ed4-93cfbd816aad None admin] PATH_INFO: `/v3/domains` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:32.657743 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d29a87-9d10-4c4a-8ed4-93cfbd816aad None admin] RBAC: Adding query filter params (name=Default) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:32.658156 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d29a87-9d10-4c4a-8ed4-93cfbd816aad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:32.659892 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d29a87-9d10-4c4a-8ed4-93cfbd816aad None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:32.676725 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 271/528] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:32.683280 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1176eee-563e-4a93-8098-57552bbc91b5 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:32.804758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1176eee-563e-4a93-8098-57552bbc91b5 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:32.847086 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9df92b-2931-4534-b64c-ebaaf1a06bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:32.847945 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9df92b-2931-4534-b64c-ebaaf1a06bb2 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:32.848192 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9df92b-2931-4534-b64c-ebaaf1a06bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:32.848473 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9df92b-2931-4534-b64c-ebaaf1a06bb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:32.857696 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9df92b-2931-4534-b64c-ebaaf1a06bb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:32.859263 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9df92b-2931-4534-b64c-ebaaf1a06bb2 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:32.861250 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:32.871909 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-7c9df92b-2931-4534-b64c-ebaaf1a06bb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:39:32.871909 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:32.871909 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:32.871909 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:32.871909 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:32.871909 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:32.871909 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:32.871909 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:32.871909 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:32.871909 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:32.871909 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:32.871909 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:32.871909 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:39:32.871909 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:39:32.871909 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:39:32.886980 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:39:32.886980 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:32.886980 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:32.886980 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:32.886980 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:32.886980 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:32.886980 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:32.886980 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:32.886980 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:32.886980 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:32.886980 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:32.886980 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:32.886980 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:32.886980 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:32.886980 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:32.886980 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:32.886980 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:32.887855 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:39:32.887855 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:39:32.887855 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:39:32.887855 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:39:32.887855 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:39:32.887855 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:39:32.887855 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:39:32.887855 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:32.887855 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 258/529] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:39:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:32.888310 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d29a87-9d10-4c4a-8ed4-93cfbd816aad None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:33.002451 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d29a87-9d10-4c4a-8ed4-93cfbd816aad None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:33.041804 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5b094-2ad2-4b89-accf-10dbf3ffdde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:33.042697 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5b094-2ad2-4b89-accf-10dbf3ffdde5 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:33.043126 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5b094-2ad2-4b89-accf-10dbf3ffdde5 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:33.043549 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5b094-2ad2-4b89-accf-10dbf3ffdde5 None admin] PATH_INFO: `/v3/projects` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:33.044395 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5b094-2ad2-4b89-accf-10dbf3ffdde5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:33.044864 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5b094-2ad2-4b89-accf-10dbf3ffdde5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:33.046587 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5b094-2ad2-4b89-accf-10dbf3ffdde5 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:33.060464 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 272/530] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 00:39:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:33.066471 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9df92b-2931-4534-b64c-ebaaf1a06bb2 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:33.196639 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9df92b-2931-4534-b64c-ebaaf1a06bb2 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:33.237851 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf9d93-883c-42dd-a4c2-182a7d84036f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:33.238742 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf9d93-883c-42dd-a4c2-182a7d84036f None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:33.239233 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf9d93-883c-42dd-a4c2-182a7d84036f None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:33.239666 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf9d93-883c-42dd-a4c2-182a7d84036f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:33.240642 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf9d93-883c-42dd-a4c2-182a7d84036f None admin] RBAC: Adding query filter params (role.id=e6933171244b410694fbc4f1d8cb0130, scope.project.id=fe7cc05cd9f44d74a635079ef883d9a9, user.id=85a98342482a4031b6d87cb1d0fbaea0) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:33.241109 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf9d93-883c-42dd-a4c2-182a7d84036f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:33.242769 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf9d93-883c-42dd-a4c2-182a7d84036f None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:33.249797 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 259/531] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 00:39:33 2022] GET /identity/v3/role_assignments?user.id=85a98342482a4031b6d87cb1d0fbaea0&scope.project.id=fe7cc05cd9f44d74a635079ef883d9a9&role.id=e6933171244b410694fbc4f1d8cb0130 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:34.051601 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bdf09-eb6d-4886-828f-0a177591ca55 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:34.051990 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bdf09-eb6d-4886-828f-0a177591ca55 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:34.052176 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bdf09-eb6d-4886-828f-0a177591ca55 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:34.053747 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 273/532] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:34.059859 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0749427-85fa-48c1-a5ed-60c776bbbcce None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:34.060152 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0749427-85fa-48c1-a5ed-60c776bbbcce None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:34.060427 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0749427-85fa-48c1-a5ed-60c776bbbcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:34.079366 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-f0749427-85fa-48c1-a5ed-60c776bbbcce None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:34.080560 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-f0749427-85fa-48c1-a5ed-60c776bbbcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:34.140883 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:34.151858 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 260/533] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:39:34.490680 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bdf09-eb6d-4886-828f-0a177591ca55 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:34.551837 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:34.610784 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bdf09-eb6d-4886-828f-0a177591ca55 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:34.651304 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8bbfc-eb6a-479e-a4fb-6783975295f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:34.652488 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8bbfc-eb6a-479e-a4fb-6783975295f0 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:34.652984 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8bbfc-eb6a-479e-a4fb-6783975295f0 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:34.653555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8bbfc-eb6a-479e-a4fb-6783975295f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:34.670393 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8bbfc-eb6a-479e-a4fb-6783975295f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:39:34.676486 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-eae8bbfc-eb6a-479e-a4fb-6783975295f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:39:34.676486 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:34.676486 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:34.676486 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:34.676486 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:34.676486 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:34.676486 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:34.676486 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:34.676486 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:34.676486 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:34.676486 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:34.676486 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:34.676486 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:39:34.676486 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:39:34.676486 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:39:34.676486 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:39:34.677508 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:39:34.677508 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:39:34.677508 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:39:34.677508 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:39:34.677508 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:34.677508 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:34.677508 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:34.677508 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:34.677508 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:34.677508 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:34.677508 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:34.677508 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:34.677508 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:34.677508 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:34.677508 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:34.677508 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:34.678275 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:34.678275 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:34.678275 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:34.678275 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:34.678275 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:39:34.678275 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:39:34.678275 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:39:34.678275 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:39:34.678275 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:39:34.678275 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:39:34.678275 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:39:34.678275 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:34.681198 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 274/534] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 00:39:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:34.690095 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0749427-85fa-48c1-a5ed-60c776bbbcce None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:34.798969 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0749427-85fa-48c1-a5ed-60c776bbbcce None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:34.836868 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586657e4-9b51-4d00-a111-3c407e1a481b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:34.837528 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586657e4-9b51-4d00-a111-3c407e1a481b None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:34.838335 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586657e4-9b51-4d00-a111-3c407e1a481b None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:34.838616 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586657e4-9b51-4d00-a111-3c407e1a481b None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:34.839366 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586657e4-9b51-4d00-a111-3c407e1a481b None admin] RBAC: Adding query filter params (name=service) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:34.839706 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586657e4-9b51-4d00-a111-3c407e1a481b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:34.841107 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586657e4-9b51-4d00-a111-3c407e1a481b None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:34.851027 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 261/535] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 00:39:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:34.853120 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58320a96-2682-4a7a-a790-e906bdbe1b6a None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:34.854177 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58320a96-2682-4a7a-a790-e906bdbe1b6a None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:34.854570 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58320a96-2682-4a7a-a790-e906bdbe1b6a None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:34.855926 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 275/536] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:39:34.858427 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586657e4-9b51-4d00-a111-3c407e1a481b None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:34.861104 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab254d8-97b2-4d82-b77e-1bf4aa7adb85 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:34.861410 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab254d8-97b2-4d82-b77e-1bf4aa7adb85 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:34.861698 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab254d8-97b2-4d82-b77e-1bf4aa7adb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:34.881581 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-fab254d8-97b2-4d82-b77e-1bf4aa7adb85 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:34.882795 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-fab254d8-97b2-4d82-b77e-1bf4aa7adb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:34.937590 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:34.969655 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 276/537] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:39:34.989065 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586657e4-9b51-4d00-a111-3c407e1a481b None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:35.027834 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65118802-498d-4adc-a719-9439057c247f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:35.028917 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65118802-498d-4adc-a719-9439057c247f None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:35.029454 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65118802-498d-4adc-a719-9439057c247f None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:35.029970 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65118802-498d-4adc-a719-9439057c247f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:35.043269 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65118802-498d-4adc-a719-9439057c247f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:35.045065 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65118802-498d-4adc-a719-9439057c247f None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:35.062982 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-65118802-498d-4adc-a719-9439057c247f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:35.062982 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:35.062982 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:35.062982 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:35.062982 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:35.062982 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:35.062982 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:35.062982 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:35.062982 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:35.062982 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:35.062982 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:35.062982 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:35.062982 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:39:35.062982 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:39:35.062982 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:39:35.062982 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:39:35.063889 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:35.063889 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:35.063889 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:35.063889 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:35.063889 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:35.063889 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:35.063889 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:35.063889 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:35.063889 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:35.063889 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:35.063889 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:35.063889 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:35.063889 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:35.063889 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:35.063889 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:35.063889 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:35.063889 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:39:35.064722 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:39:35.064722 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:35.064722 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:35.066668 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 262/538] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:35.074685 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab254d8-97b2-4d82-b77e-1bf4aa7adb85 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:35.127566 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:35.133762 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6c7f5-4f24-4b80-b033-cbf62919b495 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:35.134707 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6c7f5-4f24-4b80-b033-cbf62919b495 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:35.135780 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6c7f5-4f24-4b80-b033-cbf62919b495 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:35.141913 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 263/539] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:35 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:35.143298 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684d64f-dabb-43d0-89c5-dc9aec25e5b2 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:35.143586 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684d64f-dabb-43d0-89c5-dc9aec25e5b2 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:35.143861 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684d64f-dabb-43d0-89c5-dc9aec25e5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:35.166200 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-e684d64f-dabb-43d0-89c5-dc9aec25e5b2 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:35.167498 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-e684d64f-dabb-43d0-89c5-dc9aec25e5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:35.211001 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab254d8-97b2-4d82-b77e-1bf4aa7adb85 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:35.247825 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 264/540] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:39:35.256905 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb4a6d-a071-4e9e-ae26-2531be76d16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:35.257894 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb4a6d-a071-4e9e-ae26-2531be76d16f None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:35.258335 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb4a6d-a071-4e9e-ae26-2531be76d16f None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:35.258763 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb4a6d-a071-4e9e-ae26-2531be76d16f None admin] PATH_INFO: `/v3/domains` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:35.260353 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb4a6d-a071-4e9e-ae26-2531be76d16f None admin] RBAC: Adding query filter params (name=Default) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:35.260930 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb4a6d-a071-4e9e-ae26-2531be76d16f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:35.262545 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb4a6d-a071-4e9e-ae26-2531be76d16f None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:35.276193 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 277/541] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:35.285583 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684d64f-dabb-43d0-89c5-dc9aec25e5b2 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:35.318970 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb4a6d-a071-4e9e-ae26-2531be76d16f None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:35.323151 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:35.402136 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684d64f-dabb-43d0-89c5-dc9aec25e5b2 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:35.446256 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb4a6d-a071-4e9e-ae26-2531be76d16f None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:35.449289 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:35.453367 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1459c17-7894-4d94-8a10-822d9f0f3b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:35.454318 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1459c17-7894-4d94-8a10-822d9f0f3b22 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:35.454695 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1459c17-7894-4d94-8a10-822d9f0f3b22 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:35.455040 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1459c17-7894-4d94-8a10-822d9f0f3b22 None admin] PATH_INFO: `/v3/users/nova` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:35.465656 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1459c17-7894-4d94-8a10-822d9f0f3b22 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:35.467504 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1459c17-7894-4d94-8a10-822d9f0f3b22 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:35.484577 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-e1459c17-7894-4d94-8a10-822d9f0f3b22 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:39:35.484577 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:35.484577 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:35.484577 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:35.484577 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:35.484577 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:35.484577 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:35.484577 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:35.484577 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:35.484577 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:35.484577 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:35.484577 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:35.484577 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:39:35.484577 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:39:35.484577 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:39:35.484577 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:39:35.485767 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:35.485767 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:35.485767 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:39:35.485767 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:39:35.485767 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:39:35.485767 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:39:35.485767 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:35.485767 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:35.485767 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:35.485767 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:35.485767 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:35.485767 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:35.485767 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:35.485767 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:35.485767 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:35.485767 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:35.485767 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:35.485767 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:35.486642 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:35.486642 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:35.486642 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:39:35.486642 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:39:35.486642 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:39:35.486642 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:39:35.486642 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:39:35.486642 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:39:35.486642 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:39:35.486642 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:35.493830 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 265/542] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Aug 26 00:39:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:35.496090 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1459c17-7894-4d94-8a10-822d9f0f3b22 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:35.498655 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297714d-c149-45cf-8829-c4ba024a7a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:35.499409 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297714d-c149-45cf-8829-c4ba024a7a57 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:35.499771 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297714d-c149-45cf-8829-c4ba024a7a57 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:35.500129 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297714d-c149-45cf-8829-c4ba024a7a57 None admin] PATH_INFO: `/v3/roles/service` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:35.513536 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d297714d-c149-45cf-8829-c4ba024a7a57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:39:35.519119 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-d297714d-c149-45cf-8829-c4ba024a7a57 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:39:35.519119 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:35.519119 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:35.519119 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:35.519119 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:35.519119 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:35.519119 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:35.519119 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:35.519119 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:35.519119 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:35.519119 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:35.519119 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:35.519119 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:39:35.519119 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:39:35.519119 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:39:35.519119 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:39:35.520047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:39:35.520047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:39:35.520047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:39:35.520047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:39:35.520047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:35.520047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:35.520047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:35.520047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:35.520047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:35.520047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:35.520047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:35.520047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:35.520047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:35.520047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:35.520047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:35.520047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:35.520814 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:35.520814 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:35.520814 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:35.520814 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:35.520814 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:39:35.520814 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:39:35.520814 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:39:35.520814 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:39:35.520814 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:39:35.520814 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:39:35.520814 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:39:35.520814 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:35.525625 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 278/543] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 00:39:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:39:35.526626 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297714d-c149-45cf-8829-c4ba024a7a57 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:35.610390 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:35.618152 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1459c17-7894-4d94-8a10-822d9f0f3b22 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:35.638722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297714d-c149-45cf-8829-c4ba024a7a57 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:35.657235 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacb930-d505-4b89-8eef-64476c266cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:35.657892 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacb930-d505-4b89-8eef-64476c266cfb None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:35.658170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacb930-d505-4b89-8eef-64476c266cfb None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:35.658447 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacb930-d505-4b89-8eef-64476c266cfb None admin] PATH_INFO: `/v3/users` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:35.659195 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacb930-d505-4b89-8eef-64476c266cfb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:35.659502 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacb930-d505-4b89-8eef-64476c266cfb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:35.660992 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacb930-d505-4b89-8eef-64476c266cfb None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:35.678442 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b1fef-aa80-4a66-8f58-0cb3c3e3f12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:35.679066 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b1fef-aa80-4a66-8f58-0cb3c3e3f12c None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:35.679350 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b1fef-aa80-4a66-8f58-0cb3c3e3f12c None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:35.679643 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b1fef-aa80-4a66-8f58-0cb3c3e3f12c None admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:35.680388 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b1fef-aa80-4a66-8f58-0cb3c3e3f12c None admin] RBAC: Adding query filter params (name=service) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:35.680699 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b1fef-aa80-4a66-8f58-0cb3c3e3f12c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:35.682803 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b1fef-aa80-4a66-8f58-0cb3c3e3f12c None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:35.682942 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 266/544] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Aug 26 00:39:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:35.684422 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60050f-449a-406a-b3c1-a03cec4b9762 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:35.684729 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60050f-449a-406a-b3c1-a03cec4b9762 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:35.685010 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60050f-449a-406a-b3c1-a03cec4b9762 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:35.686919 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 267/545] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:35.688382 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60050f-449a-406a-b3c1-a03cec4b9762 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:35.694707 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 279/546] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 00:39:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:35.695476 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b1fef-aa80-4a66-8f58-0cb3c3e3f12c None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:35.722584 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:35.804466 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60050f-449a-406a-b3c1-a03cec4b9762 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:35.807572 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b1fef-aa80-4a66-8f58-0cb3c3e3f12c None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:35.845972 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885de5d0-79fb-489c-8871-bad4f7d7dc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:35.846634 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885de5d0-79fb-489c-8871-bad4f7d7dc90 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:35.846912 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885de5d0-79fb-489c-8871-bad4f7d7dc90 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:35.847184 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885de5d0-79fb-489c-8871-bad4f7d7dc90 None admin] PATH_INFO: `/v3/roles/service` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:35.854787 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54e48c-c243-4d13-865a-6bfdda193cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:35.855520 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54e48c-c243-4d13-865a-6bfdda193cfc None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:35.855809 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54e48c-c243-4d13-865a-6bfdda193cfc None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:35.856372 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54e48c-c243-4d13-865a-6bfdda193cfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:35.859838 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885de5d0-79fb-489c-8871-bad4f7d7dc90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:39:35.864811 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-885de5d0-79fb-489c-8871-bad4f7d7dc90 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:39:35.864811 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:35.864811 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:35.864811 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:35.864811 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:35.864811 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:35.864811 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:35.864811 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:35.864811 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:35.864811 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:35.864811 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:35.864811 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:35.864811 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:39:35.864811 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:39:35.864811 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:39:35.864811 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:39:35.866266 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:39:35.866266 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:39:35.866266 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:39:35.866266 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:39:35.866266 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:35.866266 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:35.866266 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:35.866266 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:35.866266 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:35.866266 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:35.866266 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:35.866266 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:35.866266 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:35.866266 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:35.866266 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:35.866266 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:35.867316 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:35.867316 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:35.867316 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:35.867316 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:35.867316 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:39:35.867316 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:39:35.867316 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:39:35.867316 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:39:35.867316 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:39:35.867316 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:39:35.867316 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:39:35.867316 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:35.867316 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 268/547] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 00:39:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:35.867316 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d2e07-af83-481a-84f6-64126f8ce576 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:35.870409 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d2e07-af83-481a-84f6-64126f8ce576 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:35.870409 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d2e07-af83-481a-84f6-64126f8ce576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:35.874089 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54e48c-c243-4d13-865a-6bfdda193cfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:35.875607 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54e48c-c243-4d13-865a-6bfdda193cfc None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:35.891736 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-ec9d2e07-af83-481a-84f6-64126f8ce576 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:35.892166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-cb54e48c-c243-4d13-865a-6bfdda193cfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:35.892166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:35.892166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:35.892166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:35.892166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:35.892166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:35.892166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:35.892166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:35.892166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:35.892166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:35.892166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:35.892166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:35.892166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:39:35.892166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:39:35.892166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:39:35.892166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:39:35.894337 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:35.894337 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:35.894337 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:35.894337 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:35.894337 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:35.894337 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:35.894337 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:35.894337 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:35.894337 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:35.894337 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:35.894337 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:35.894337 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:35.894337 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:35.894337 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:35.894337 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:35.894337 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:35.894337 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:39:35.895734 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:39:35.895734 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:35.895734 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:35.896016 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-ec9d2e07-af83-481a-84f6-64126f8ce576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:35.896103 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 280/548] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:35.896103 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54e48c-c243-4d13-865a-6bfdda193cfc None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:35.906611 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:35.988743 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:35.991903 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 269/549] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:39:35.991903 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d2e07-af83-481a-84f6-64126f8ce576 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:36.019920 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54e48c-c243-4d13-865a-6bfdda193cfc None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:36.066125 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfefb231-e6a3-46b2-bed2-ff07dffd5b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:36.066763 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefb231-e6a3-46b2-bed2-ff07dffd5b43 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:36.067282 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefb231-e6a3-46b2-bed2-ff07dffd5b43 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:36.067428 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefb231-e6a3-46b2-bed2-ff07dffd5b43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:36.079434 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfefb231-e6a3-46b2-bed2-ff07dffd5b43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:36.080922 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfefb231-e6a3-46b2-bed2-ff07dffd5b43 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:36.097484 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-cfefb231-e6a3-46b2-bed2-ff07dffd5b43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:36.097484 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:36.097484 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:36.097484 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:36.097484 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:36.097484 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:36.097484 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:36.097484 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:36.097484 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:36.097484 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:36.097484 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:36.097484 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:36.097484 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:39:36.097484 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:39:36.097484 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:39:36.097484 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:39:36.099022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:36.099022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:36.099022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:36.099022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:36.099022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:36.099022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:36.099022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:36.099022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:36.099022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:36.099022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:36.099022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:36.099022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:36.099022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:36.099022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:36.099022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:36.099022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:36.099022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:39:36.100803 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:39:36.100803 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:36.100803 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:36.100803 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 281/550] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:36.100803 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfefb231-e6a3-46b2-bed2-ff07dffd5b43 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:36.122893 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d2e07-af83-481a-84f6-64126f8ce576 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:36.169498 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c49bf-e81b-4a8b-9fef-0051f941d4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:36.170280 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c49bf-e81b-4a8b-9fef-0051f941d4f5 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:36.170948 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c49bf-e81b-4a8b-9fef-0051f941d4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:36.170948 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c49bf-e81b-4a8b-9fef-0051f941d4f5 None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:36.171707 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c49bf-e81b-4a8b-9fef-0051f941d4f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:36.172556 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c49bf-e81b-4a8b-9fef-0051f941d4f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:36.173496 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c49bf-e81b-4a8b-9fef-0051f941d4f5 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:36.184022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 270/551] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 00:39:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:36.188713 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c49bf-e81b-4a8b-9fef-0051f941d4f5 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:36.200260 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:36.237297 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfefb231-e6a3-46b2-bed2-ff07dffd5b43 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:36.271863 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:36.282093 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad001f41-dc35-4123-af53-2ace16a153bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:36.282757 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad001f41-dc35-4123-af53-2ace16a153bf None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:36.283064 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad001f41-dc35-4123-af53-2ace16a153bf None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:36.283323 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad001f41-dc35-4123-af53-2ace16a153bf None admin] PATH_INFO: `/v3/domains` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:36.284010 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad001f41-dc35-4123-af53-2ace16a153bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:36.284320 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad001f41-dc35-4123-af53-2ace16a153bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:36.285796 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad001f41-dc35-4123-af53-2ace16a153bf None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:36.301094 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 282/552] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:36.302319 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad001f41-dc35-4123-af53-2ace16a153bf None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:36.311875 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c49bf-e81b-4a8b-9fef-0051f941d4f5 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:36.357241 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485abf41-eb85-4465-b190-61371cb0627d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:36.357898 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485abf41-eb85-4465-b190-61371cb0627d None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:36.358190 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485abf41-eb85-4465-b190-61371cb0627d None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:36.358487 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485abf41-eb85-4465-b190-61371cb0627d None admin] PATH_INFO: `/v3/domains` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:36.359116 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485abf41-eb85-4465-b190-61371cb0627d None admin] RBAC: Adding query filter params (name=Default) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:36.359428 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485abf41-eb85-4465-b190-61371cb0627d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:36.360824 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485abf41-eb85-4465-b190-61371cb0627d None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:36.379427 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 271/553] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:36.379427 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485abf41-eb85-4465-b190-61371cb0627d None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:36.422227 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad001f41-dc35-4123-af53-2ace16a153bf None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:36.453144 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:36.460741 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ac4a5-3543-469f-869c-30073d80ffff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:36.464749 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ac4a5-3543-469f-869c-30073d80ffff None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:36.464749 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ac4a5-3543-469f-869c-30073d80ffff None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:36.464749 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ac4a5-3543-469f-869c-30073d80ffff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:36.473221 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92ac4a5-3543-469f-869c-30073d80ffff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:36.474743 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92ac4a5-3543-469f-869c-30073d80ffff None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:36.491138 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-a92ac4a5-3543-469f-869c-30073d80ffff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:36.491138 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:36.491138 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:36.491138 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:36.491138 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:36.491138 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:36.491138 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:36.491138 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:36.491138 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:36.491138 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:36.491138 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:36.491138 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:36.491138 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:39:36.491138 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:39:36.491138 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:39:36.491138 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:39:36.492144 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:36.492144 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:36.492144 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:36.492144 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:36.492144 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:36.492144 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:36.492144 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:36.492144 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:36.492144 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:36.492144 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:36.492144 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:36.492144 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:36.492144 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:36.492144 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:36.492144 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:36.492144 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:36.492144 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:39:36.492983 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:39:36.492983 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:36.492983 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:36.493146 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485abf41-eb85-4465-b190-61371cb0627d None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:36.493217 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 283/554] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:36.493760 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ac4a5-3543-469f-869c-30073d80ffff None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:36.530168 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64944bbe-1b39-47a8-a79f-96fdb3aa8b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:36.530903 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64944bbe-1b39-47a8-a79f-96fdb3aa8b41 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:36.531212 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64944bbe-1b39-47a8-a79f-96fdb3aa8b41 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:36.531573 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64944bbe-1b39-47a8-a79f-96fdb3aa8b41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:36.539419 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64944bbe-1b39-47a8-a79f-96fdb3aa8b41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:36.541302 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:36.542043 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64944bbe-1b39-47a8-a79f-96fdb3aa8b41 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:36.553415 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-64944bbe-1b39-47a8-a79f-96fdb3aa8b41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:39:36.553415 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:36.553415 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:36.553415 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:36.553415 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:36.553415 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:36.553415 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:36.553415 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:36.553415 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:36.553415 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:36.553415 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:36.553415 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:36.553415 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:39:36.553415 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:39:36.553415 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:39:36.554353 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:39:36.554353 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:36.554353 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:36.554353 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:36.554353 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:36.554353 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:36.554353 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:36.554353 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:36.554353 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:36.554353 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:36.554353 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:36.554353 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:36.554353 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:36.554353 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:36.554353 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:36.554353 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:36.554353 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:36.555203 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:39:36.555203 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:39:36.555203 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:39:36.555203 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:39:36.555203 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:39:36.555203 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:39:36.555203 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:39:36.555203 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:36.555203 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 272/555] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:39:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:36.555664 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64944bbe-1b39-47a8-a79f-96fdb3aa8b41 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:36.603989 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ac4a5-3543-469f-869c-30073d80ffff None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:36.638499 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c569f1e-5bf1-4e44-9527-ef82bbe5beaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:36.639086 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c569f1e-5bf1-4e44-9527-ef82bbe5beaf None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:36.639371 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c569f1e-5bf1-4e44-9527-ef82bbe5beaf None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:36.639643 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c569f1e-5bf1-4e44-9527-ef82bbe5beaf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:36.647414 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c569f1e-5bf1-4e44-9527-ef82bbe5beaf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:36.648878 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c569f1e-5bf1-4e44-9527-ef82bbe5beaf None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:36.660275 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64944bbe-1b39-47a8-a79f-96fdb3aa8b41 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:36.661626 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-6c569f1e-5bf1-4e44-9527-ef82bbe5beaf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 00:39:36.661626 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:36.661626 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:36.661626 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:36.661626 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:36.661626 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:36.661626 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:36.661626 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:36.661626 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:36.661626 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:36.661626 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:36.661626 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:36.661626 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:39:36.661626 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:39:36.661626 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:39:36.661626 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:39:36.662712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:36.662712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:36.662712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:39:36.662712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:39:36.662712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:39:36.662712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:39:36.662712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:36.662712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:36.662712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:36.662712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:36.662712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:36.662712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:36.662712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:36.662712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:36.662712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:36.662712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:36.662712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:36.662712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:36.663877 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:36.663877 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:36.663877 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:39:36.663877 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:39:36.663877 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:39:36.663877 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:39:36.663877 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:39:36.663877 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:39:36.663877 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 00:39:36.663877 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:36.663877 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 284/556] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 00:39:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:36.663877 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c569f1e-5bf1-4e44-9527-ef82bbe5beaf None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:36.696962 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:36.706907 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e194af4-141a-445e-ba04-aea4bf26667a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:36.712575 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e194af4-141a-445e-ba04-aea4bf26667a None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:36.712575 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e194af4-141a-445e-ba04-aea4bf26667a None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:36.712575 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e194af4-141a-445e-ba04-aea4bf26667a None admin] PATH_INFO: `/v3/roles/service` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:36.719565 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e194af4-141a-445e-ba04-aea4bf26667a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:39:36.724541 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-6e194af4-141a-445e-ba04-aea4bf26667a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:39:36.724541 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:36.724541 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:36.724541 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:36.724541 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:36.724541 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:36.724541 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:36.724541 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:36.724541 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:36.724541 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:36.724541 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:36.724541 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:36.724541 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:39:36.724541 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:39:36.724541 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:39:36.724541 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:39:36.725715 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:39:36.725715 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:39:36.725715 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:39:36.725715 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:39:36.725715 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:36.725715 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:36.725715 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:36.725715 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:36.725715 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:36.725715 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:36.725715 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:36.725715 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:36.725715 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:36.725715 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:36.725715 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:36.725715 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:36.727084 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:36.727084 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:36.727084 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:36.727084 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:36.727084 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:39:36.727084 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:39:36.727084 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:39:36.727084 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:39:36.727084 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:39:36.727084 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:39:36.727084 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:39:36.727084 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:36.727084 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 273/557] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 00:39:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:36.729642 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e194af4-141a-445e-ba04-aea4bf26667a None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:36.788210 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:36.792026 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c569f1e-5bf1-4e44-9527-ef82bbe5beaf None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:36.833197 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1059dc-e822-4aca-82ac-8ea0c0e2cf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:36.833847 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1059dc-e822-4aca-82ac-8ea0c0e2cf18 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:36.834133 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1059dc-e822-4aca-82ac-8ea0c0e2cf18 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:36.834410 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1059dc-e822-4aca-82ac-8ea0c0e2cf18 None admin] PATH_INFO: `/v3/domains` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:36.835071 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1059dc-e822-4aca-82ac-8ea0c0e2cf18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:36.835380 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1059dc-e822-4aca-82ac-8ea0c0e2cf18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:36.836772 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1059dc-e822-4aca-82ac-8ea0c0e2cf18 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:36.847166 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e194af4-141a-445e-ba04-aea4bf26667a None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:36.849941 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 285/558] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:36.850794 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1059dc-e822-4aca-82ac-8ea0c0e2cf18 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:36.889869 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b20f3a-f439-4fc0-bccd-c31dcf337c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:36.890338 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b20f3a-f439-4fc0-bccd-c31dcf337c76 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:36.890646 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b20f3a-f439-4fc0-bccd-c31dcf337c76 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:36.890927 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b20f3a-f439-4fc0-bccd-c31dcf337c76 None admin] PATH_INFO: `/v3/projects` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:36.891715 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b20f3a-f439-4fc0-bccd-c31dcf337c76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:36.891964 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b20f3a-f439-4fc0-bccd-c31dcf337c76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:36.893464 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b20f3a-f439-4fc0-bccd-c31dcf337c76 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:36.906659 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 274/559] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 00:39:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:36.909487 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b20f3a-f439-4fc0-bccd-c31dcf337c76 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:36.963697 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:36.971902 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1059dc-e822-4aca-82ac-8ea0c0e2cf18 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:37.011457 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4285c-2c7b-40df-b05b-f24608e75942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:37.012074 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4285c-2c7b-40df-b05b-f24608e75942 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:37.012360 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4285c-2c7b-40df-b05b-f24608e75942 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:37.012634 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4285c-2c7b-40df-b05b-f24608e75942 None admin] PATH_INFO: `/v3/users` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:37.013408 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4285c-2c7b-40df-b05b-f24608e75942 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:37.013719 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4285c-2c7b-40df-b05b-f24608e75942 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:37.015174 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4285c-2c7b-40df-b05b-f24608e75942 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:37.021732 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b20f3a-f439-4fc0-bccd-c31dcf337c76 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:37.033645 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 286/560] 10.222.0.20 () {56 vars in 1139 bytes} [Fri Aug 26 00:39:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:37.034501 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4285c-2c7b-40df-b05b-f24608e75942 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:37.054231 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:37.062069 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5203275-f83f-4905-970b-5a0fb80091cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:37.062702 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5203275-f83f-4905-970b-5a0fb80091cc None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:37.062990 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5203275-f83f-4905-970b-5a0fb80091cc None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:37.063270 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5203275-f83f-4905-970b-5a0fb80091cc None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:37.064022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5203275-f83f-4905-970b-5a0fb80091cc None admin] RBAC: Adding query filter params (name=service) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:37.064261 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5203275-f83f-4905-970b-5a0fb80091cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:37.065705 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5203275-f83f-4905-970b-5a0fb80091cc None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:37.075188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 275/561] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 00:39:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:37.076107 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5203275-f83f-4905-970b-5a0fb80091cc None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:37.141975 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4285c-2c7b-40df-b05b-f24608e75942 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:37.186148 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5203275-f83f-4905-970b-5a0fb80091cc None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:37.186823 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d112b2-12c9-44a0-9106-a31897d5451b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:37.187950 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d112b2-12c9-44a0-9106-a31897d5451b None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:37.188459 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d112b2-12c9-44a0-9106-a31897d5451b None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:37.188949 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d112b2-12c9-44a0-9106-a31897d5451b None admin] PATH_INFO: `/v3/users/glance` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:37.195570 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:37.203101 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d112b2-12c9-44a0-9106-a31897d5451b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:37.206007 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d112b2-12c9-44a0-9106-a31897d5451b None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:37.222527 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-a4d112b2-12c9-44a0-9106-a31897d5451b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 26 00:39:37.222527 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:37.222527 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:37.222527 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:37.222527 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:37.222527 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:37.222527 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:37.222527 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:37.222527 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:37.222527 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:37.222527 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:37.222527 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:37.222527 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:39:37.222527 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:39:37.222527 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:39:37.222527 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:39:37.231364 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:37.231364 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:37.231364 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:39:37.231364 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:39:37.231364 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:39:37.231364 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:39:37.231364 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:37.231364 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:37.231364 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:37.231364 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:37.231364 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:37.231364 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:37.231364 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:37.231364 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:37.231364 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:37.231364 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:37.231364 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:37.231364 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:37.232403 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:37.232403 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:37.232403 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:39:37.232403 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:39:37.232403 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:39:37.232403 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:39:37.232403 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:39:37.232403 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:39:37.232403 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 26 00:39:37.232403 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:37.232403 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 287/562] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:39:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:37.232403 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d112b2-12c9-44a0-9106-a31897d5451b None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:37.233361 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c6703-9dc6-46dd-ae66-c0005b6146b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:37.233361 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c6703-9dc6-46dd-ae66-c0005b6146b5 None admin] REQUEST_METHOD: `PUT` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:37.233361 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c6703-9dc6-46dd-ae66-c0005b6146b5 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:37.233361 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c6703-9dc6-46dd-ae66-c0005b6146b5 None admin] PATH_INFO: `/v3/projects/fe7cc05cd9f44d74a635079ef883d9a9/users/02f74984033043ecabd28df33960a37c/roles/e6933171244b410694fbc4f1d8cb0130` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:37.248465 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c6703-9dc6-46dd-ae66-c0005b6146b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe7cc05cd9f44d74a635079ef883d9a9, user_id=02f74984033043ecabd28df33960a37c, role_id=e6933171244b410694fbc4f1d8cb0130)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:37.250144 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c6703-9dc6-46dd-ae66-c0005b6146b5 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:37.314299 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:37.336302 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d112b2-12c9-44a0-9106-a31897d5451b None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:37.367050 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 276/563] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 00:39:37 2022] PUT /identity/v3/projects/fe7cc05cd9f44d74a635079ef883d9a9/users/02f74984033043ecabd28df33960a37c/roles/e6933171244b410694fbc4f1d8cb0130 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:37.367919 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c6703-9dc6-46dd-ae66-c0005b6146b5 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:37.373446 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c25fd-b1a0-42a2-a722-c3db45bb9a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:37.374484 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c25fd-b1a0-42a2-a722-c3db45bb9a99 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:37.374927 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c25fd-b1a0-42a2-a722-c3db45bb9a99 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:37.375382 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c25fd-b1a0-42a2-a722-c3db45bb9a99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:37.391802 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c25fd-b1a0-42a2-a722-c3db45bb9a99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:37.393471 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c25fd-b1a0-42a2-a722-c3db45bb9a99 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:37.410256 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-cb1c25fd-b1a0-42a2-a722-c3db45bb9a99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:37.410256 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:37.410256 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:37.410256 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:37.410256 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:37.410256 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:37.410256 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:37.410256 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:37.410256 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:37.410256 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:37.410256 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:37.410256 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:37.410256 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:39:37.410256 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:39:37.410256 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:39:37.410256 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:39:37.411318 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:37.411318 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:37.411318 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:37.411318 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:37.411318 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:37.411318 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:37.411318 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:37.411318 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:37.411318 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:37.411318 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:37.411318 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:37.411318 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:37.411318 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:37.411318 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:37.411318 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:37.411318 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:37.411318 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:39:37.412214 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:39:37.412214 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:37.412214 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:37.412214 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 288/564] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:37.412909 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c25fd-b1a0-42a2-a722-c3db45bb9a99 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:37.516079 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c6703-9dc6-46dd-ae66-c0005b6146b5 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:37.550303 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c25fd-b1a0-42a2-a722-c3db45bb9a99 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:37.561195 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d511d-6932-4b9d-b796-cea5d3e5a045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:37.561984 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d511d-6932-4b9d-b796-cea5d3e5a045 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:37.562340 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d511d-6932-4b9d-b796-cea5d3e5a045 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:37.562679 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d511d-6932-4b9d-b796-cea5d3e5a045 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:37.575912 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d511d-6932-4b9d-b796-cea5d3e5a045 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:37.577427 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d511d-6932-4b9d-b796-cea5d3e5a045 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:37.592979 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:37.600769 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-661d511d-6932-4b9d-b796-cea5d3e5a045 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:37.600769 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:37.600769 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:37.600769 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:37.600769 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:37.600769 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:37.600769 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:37.600769 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:37.600769 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:37.600769 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:37.600769 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:37.600769 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:37.600769 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:39:37.600769 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:39:37.600769 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:39:37.600769 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:39:37.602022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:37.602022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:37.602022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:37.602022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:37.602022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:37.602022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:37.602022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:37.602022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:37.602022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:37.602022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:37.602022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:37.602022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:37.602022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:37.602022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:37.602022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:37.602022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:37.602022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:39:37.603117 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:39:37.603117 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:37.603117 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:37.606170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 277/565] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:37.607003 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d511d-6932-4b9d-b796-cea5d3e5a045 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:37.610668 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961569ce-ac14-4148-a8e7-4e5c8b57e1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:37.611577 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961569ce-ac14-4148-a8e7-4e5c8b57e1d6 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:37.611865 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961569ce-ac14-4148-a8e7-4e5c8b57e1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:37.612150 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961569ce-ac14-4148-a8e7-4e5c8b57e1d6 None admin] PATH_INFO: `/v3/users` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:37.613679 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961569ce-ac14-4148-a8e7-4e5c8b57e1d6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:37.614103 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961569ce-ac14-4148-a8e7-4e5c8b57e1d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:37.615840 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961569ce-ac14-4148-a8e7-4e5c8b57e1d6 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:37.622826 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:37.637303 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 289/566] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Aug 26 00:39:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:37.638214 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961569ce-ac14-4148-a8e7-4e5c8b57e1d6 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:37.738726 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d511d-6932-4b9d-b796-cea5d3e5a045 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:37.772615 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961569ce-ac14-4148-a8e7-4e5c8b57e1d6 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:37.780585 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b724b6-5d8d-4b76-85b5-db1b427396ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:37.781390 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b724b6-5d8d-4b76-85b5-db1b427396ba None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:37.781774 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b724b6-5d8d-4b76-85b5-db1b427396ba None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:37.782148 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b724b6-5d8d-4b76-85b5-db1b427396ba None admin] PATH_INFO: `/v3/domains` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:37.782913 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b724b6-5d8d-4b76-85b5-db1b427396ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:37.783314 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b724b6-5d8d-4b76-85b5-db1b427396ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:37.784813 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b724b6-5d8d-4b76-85b5-db1b427396ba None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:37.803130 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 278/567] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:37.803130 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b724b6-5d8d-4b76-85b5-db1b427396ba None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:37.819359 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a16ae-50ae-483f-bd38-97a6c1152dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:37.819972 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a16ae-50ae-483f-bd38-97a6c1152dc3 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:37.820243 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a16ae-50ae-483f-bd38-97a6c1152dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:37.820517 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a16ae-50ae-483f-bd38-97a6c1152dc3 None admin] PATH_INFO: `/v3/domains` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:37.821169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a16ae-50ae-483f-bd38-97a6c1152dc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:37.821523 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a16ae-50ae-483f-bd38-97a6c1152dc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:37.822964 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a16ae-50ae-483f-bd38-97a6c1152dc3 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:37.841112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 290/568] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:37.841112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a16ae-50ae-483f-bd38-97a6c1152dc3 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:37.891981 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:37.898308 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:37.930538 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b724b6-5d8d-4b76-85b5-db1b427396ba None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:37.965781 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a16ae-50ae-483f-bd38-97a6c1152dc3 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:37.973771 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4faab8-ac21-4f54-b6d1-ba2c70e6fce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:37.974545 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4faab8-ac21-4f54-b6d1-ba2c70e6fce6 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:37.974839 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4faab8-ac21-4f54-b6d1-ba2c70e6fce6 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:37.974839 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4faab8-ac21-4f54-b6d1-ba2c70e6fce6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:37.987167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4faab8-ac21-4f54-b6d1-ba2c70e6fce6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:37.989619 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4faab8-ac21-4f54-b6d1-ba2c70e6fce6 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:38.003090 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369deb94-b2e9-4e0c-99af-edc9f6d1dd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:38.003733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369deb94-b2e9-4e0c-99af-edc9f6d1dd2c None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:38.004018 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369deb94-b2e9-4e0c-99af-edc9f6d1dd2c None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:38.004293 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369deb94-b2e9-4e0c-99af-edc9f6d1dd2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:38.010692 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-af4faab8-ac21-4f54-b6d1-ba2c70e6fce6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:38.010692 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:38.010692 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:38.010692 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:38.010692 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:38.010692 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:38.010692 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:38.010692 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:38.010692 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:38.010692 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:38.010692 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:38.010692 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:38.010692 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:39:38.010692 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:39:38.010692 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:39:38.010692 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:39:38.011604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:38.011604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:38.011604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:38.011604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:38.011604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:38.011604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:38.011604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:38.011604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:38.011604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:38.011604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:38.011604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:38.011604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:38.011604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:38.011604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:38.011604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:38.011604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:38.011604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:39:38.012461 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:39:38.012461 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:38.012461 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:38.013757 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369deb94-b2e9-4e0c-99af-edc9f6d1dd2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:38.014452 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 279/569] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:38.015260 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369deb94-b2e9-4e0c-99af-edc9f6d1dd2c None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:38.015565 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4faab8-ac21-4f54-b6d1-ba2c70e6fce6 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:38.031753 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-369deb94-b2e9-4e0c-99af-edc9f6d1dd2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:39:38.031753 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:38.031753 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:38.031753 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:38.031753 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:38.031753 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:38.031753 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:38.031753 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:38.031753 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:38.031753 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:38.031753 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:38.031753 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:38.031753 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:39:38.031753 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:39:38.031753 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:39:38.032801 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:39:38.032801 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:38.032801 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:38.032801 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:38.032801 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:38.032801 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:38.032801 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:38.032801 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:38.032801 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:38.032801 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:38.032801 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:38.032801 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:38.032801 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:38.032801 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:38.032801 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:38.032801 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:38.032801 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:38.033711 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:39:38.033711 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:39:38.033711 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:39:38.033711 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:39:38.033711 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:39:38.033711 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:39:38.033711 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:39:38.033711 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:38.039876 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 291/570] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:39:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:38.039876 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369deb94-b2e9-4e0c-99af-edc9f6d1dd2c None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:38.139914 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4faab8-ac21-4f54-b6d1-ba2c70e6fce6 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:38.158584 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369deb94-b2e9-4e0c-99af-edc9f6d1dd2c None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:38.167277 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:38.169903 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:38.181240 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91c41a-e213-4eb1-96e9-62c2e1e5b963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:38.182221 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91c41a-e213-4eb1-96e9-62c2e1e5b963 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:38.182385 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91c41a-e213-4eb1-96e9-62c2e1e5b963 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:38.182745 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91c41a-e213-4eb1-96e9-62c2e1e5b963 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:38.190959 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91c41a-e213-4eb1-96e9-62c2e1e5b963 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:38.192444 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91c41a-e213-4eb1-96e9-62c2e1e5b963 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:38.197825 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c15af8-d082-4a5f-b4fe-7c27f47e7551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:38.198462 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c15af8-d082-4a5f-b4fe-7c27f47e7551 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:38.198743 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c15af8-d082-4a5f-b4fe-7c27f47e7551 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:38.199014 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c15af8-d082-4a5f-b4fe-7c27f47e7551 None admin] PATH_INFO: `/v3/domains` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:38.199734 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c15af8-d082-4a5f-b4fe-7c27f47e7551 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:38.200152 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c15af8-d082-4a5f-b4fe-7c27f47e7551 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:38.201480 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c15af8-d082-4a5f-b4fe-7c27f47e7551 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:38.205877 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-cf91c41a-e213-4eb1-96e9-62c2e1e5b963 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 00:39:38.205877 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:38.205877 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:38.205877 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:38.205877 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:38.205877 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:38.205877 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:38.205877 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:38.205877 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:38.205877 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:38.205877 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:38.205877 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:38.205877 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:39:38.205877 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:39:38.205877 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:39:38.205877 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:39:38.206947 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:38.206947 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:38.206947 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:39:38.206947 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:39:38.206947 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:39:38.206947 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:39:38.206947 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:38.206947 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:38.206947 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:38.206947 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:38.206947 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:38.206947 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:38.206947 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:38.206947 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:38.206947 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:38.206947 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:38.206947 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:38.206947 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:38.207844 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:38.207844 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:38.207844 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:39:38.207844 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:39:38.207844 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:39:38.207844 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:39:38.207844 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:39:38.207844 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:39:38.207844 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 00:39:38.207844 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:38.211730 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 280/571] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:39:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:38.213609 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91c41a-e213-4eb1-96e9-62c2e1e5b963 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:38.222300 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 292/572] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:38.222300 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c15af8-d082-4a5f-b4fe-7c27f47e7551 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:38.342873 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91c41a-e213-4eb1-96e9-62c2e1e5b963 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:38.345961 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c15af8-d082-4a5f-b4fe-7c27f47e7551 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:38.380243 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8d2fb-2ac4-4049-8b4d-aa3b3191efcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:38.380954 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8d2fb-2ac4-4049-8b4d-aa3b3191efcc None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:38.381250 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8d2fb-2ac4-4049-8b4d-aa3b3191efcc None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:38.381584 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8d2fb-2ac4-4049-8b4d-aa3b3191efcc None admin] PATH_INFO: `/v3/projects` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:38.382283 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8d2fb-2ac4-4049-8b4d-aa3b3191efcc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:38.382597 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8d2fb-2ac4-4049-8b4d-aa3b3191efcc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:38.384038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8d2fb-2ac4-4049-8b4d-aa3b3191efcc None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:38.388783 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a0f96-01fa-4081-af4f-b8f53fc888f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:38.389591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a0f96-01fa-4081-af4f-b8f53fc888f7 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:38.389757 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a0f96-01fa-4081-af4f-b8f53fc888f7 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:38.389960 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a0f96-01fa-4081-af4f-b8f53fc888f7 None admin] PATH_INFO: `/v3/users` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:38.390727 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a0f96-01fa-4081-af4f-b8f53fc888f7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:38.391047 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a0f96-01fa-4081-af4f-b8f53fc888f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:38.392439 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a0f96-01fa-4081-af4f-b8f53fc888f7 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:38.407092 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 281/573] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 00:39:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:38.407092 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8d2fb-2ac4-4049-8b4d-aa3b3191efcc None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:38.419679 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 293/574] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Aug 26 00:39:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:38.420535 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a0f96-01fa-4081-af4f-b8f53fc888f7 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:38.463124 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:38.476477 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:38.555831 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8d2fb-2ac4-4049-8b4d-aa3b3191efcc None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:38.562272 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a0f96-01fa-4081-af4f-b8f53fc888f7 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:38.597162 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5ae4f-0850-4a3a-ab44-8098b734f03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:38.597728 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5ae4f-0850-4a3a-ab44-8098b734f03c None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:38.598010 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5ae4f-0850-4a3a-ab44-8098b734f03c None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:38.598284 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5ae4f-0850-4a3a-ab44-8098b734f03c None admin] PATH_INFO: `/v3/projects/service` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:38.606448 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c5ae4f-0850-4a3a-ab44-8098b734f03c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:38.607940 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c5ae4f-0850-4a3a-ab44-8098b734f03c None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:38.610849 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2dc41f-5ab8-4beb-9ba3-fe2ec4b3f697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:38.611538 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dc41f-5ab8-4beb-9ba3-fe2ec4b3f697 None admin] REQUEST_METHOD: `PUT` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:38.611825 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dc41f-5ab8-4beb-9ba3-fe2ec4b3f697 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:38.612106 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dc41f-5ab8-4beb-9ba3-fe2ec4b3f697 None admin] PATH_INFO: `/v3/projects/fe7cc05cd9f44d74a635079ef883d9a9/users/fd3d4bf8049a44749b6be1d565303176/roles/e6933171244b410694fbc4f1d8cb0130` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:38.623193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-a9c5ae4f-0850-4a3a-ab44-8098b734f03c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:39:38.623193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:38.623193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:38.623193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:38.623193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:38.623193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:38.623193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:38.623193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:38.623193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:38.623193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:38.623193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:38.623193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:38.623193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:39:38.623193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:39:38.623193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:39:38.624254 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:39:38.624254 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:38.624254 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:38.624254 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:38.624254 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:38.624254 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:38.624254 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:38.624254 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:38.624254 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:38.624254 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:38.624254 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:38.624254 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:38.624254 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:38.624254 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:38.624254 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:38.624254 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:38.624254 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:38.625211 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:39:38.625211 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:39:38.625211 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:39:38.625211 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:39:38.625211 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:39:38.625211 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:39:38.625211 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:39:38.625211 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:38.631534 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2dc41f-5ab8-4beb-9ba3-fe2ec4b3f697 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe7cc05cd9f44d74a635079ef883d9a9, user_id=fd3d4bf8049a44749b6be1d565303176, role_id=e6933171244b410694fbc4f1d8cb0130)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:38.631859 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 282/575] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:39:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:38.632365 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2dc41f-5ab8-4beb-9ba3-fe2ec4b3f697 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:38.633121 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5ae4f-0850-4a3a-ab44-8098b734f03c None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:38.733419 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 294/576] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 00:39:38 2022] PUT /identity/v3/projects/fe7cc05cd9f44d74a635079ef883d9a9/users/fd3d4bf8049a44749b6be1d565303176/roles/e6933171244b410694fbc4f1d8cb0130 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:38.733419 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2dc41f-5ab8-4beb-9ba3-fe2ec4b3f697 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:38.765516 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5ae4f-0850-4a3a-ab44-8098b734f03c None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:38.769357 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:38.838468 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30dd59d-980b-4cd1-aeb8-7d2d0ae493ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:38.839163 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dd59d-980b-4cd1-aeb8-7d2d0ae493ea None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:38.839449 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dd59d-980b-4cd1-aeb8-7d2d0ae493ea None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:38.839724 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dd59d-980b-4cd1-aeb8-7d2d0ae493ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:38.847314 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:38.857884 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30dd59d-980b-4cd1-aeb8-7d2d0ae493ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:38.860217 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30dd59d-980b-4cd1-aeb8-7d2d0ae493ea None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:38.879253 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2dc41f-5ab8-4beb-9ba3-fe2ec4b3f697 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:38.881471 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-a30dd59d-980b-4cd1-aeb8-7d2d0ae493ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:38.881471 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:38.881471 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:38.881471 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:38.881471 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:38.881471 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:38.881471 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:38.881471 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:38.881471 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:38.881471 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:38.881471 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:38.881471 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:38.881471 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:39:38.881471 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:39:38.881471 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:39:38.881471 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:39:38.882485 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:38.882485 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:38.882485 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:38.882485 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:38.882485 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:38.882485 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:38.882485 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:38.882485 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:38.882485 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:38.882485 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:38.882485 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:38.882485 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:38.882485 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:38.882485 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:38.882485 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:38.882485 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:38.882485 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:39:38.883381 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:39:38.883381 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:38.883381 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:38.885539 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 283/577] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:38.889707 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30dd59d-980b-4cd1-aeb8-7d2d0ae493ea None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:38.933927 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84716c5b-f797-4d62-a644-c28fb918f1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:38.934932 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84716c5b-f797-4d62-a644-c28fb918f1fc None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:38.935503 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84716c5b-f797-4d62-a644-c28fb918f1fc None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:38.936207 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84716c5b-f797-4d62-a644-c28fb918f1fc None admin] PATH_INFO: `/v3/projects` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:38.940106 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84716c5b-f797-4d62-a644-c28fb918f1fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:38.940106 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84716c5b-f797-4d62-a644-c28fb918f1fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:38.940106 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84716c5b-f797-4d62-a644-c28fb918f1fc None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:38.957081 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 295/578] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 00:39:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:38.965546 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84716c5b-f797-4d62-a644-c28fb918f1fc None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:39.054008 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30dd59d-980b-4cd1-aeb8-7d2d0ae493ea None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:39.122843 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb544c6-b25b-4c4e-98b0-9903c46cdf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:39.123396 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb544c6-b25b-4c4e-98b0-9903c46cdf4a None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:39.123684 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb544c6-b25b-4c4e-98b0-9903c46cdf4a None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:39.124120 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb544c6-b25b-4c4e-98b0-9903c46cdf4a None admin] PATH_INFO: `/v3/domains` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:39.124920 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb544c6-b25b-4c4e-98b0-9903c46cdf4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:39.125240 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb544c6-b25b-4c4e-98b0-9903c46cdf4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:39.127086 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb544c6-b25b-4c4e-98b0-9903c46cdf4a None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:39.133274 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84716c5b-f797-4d62-a644-c28fb918f1fc None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:39.143366 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 284/579] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:39.151040 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb544c6-b25b-4c4e-98b0-9903c46cdf4a None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:39.178556 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:39.199669 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e83120-3a5f-458d-92ec-7f0d41e68cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:39.200311 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e83120-3a5f-458d-92ec-7f0d41e68cac None admin] REQUEST_METHOD: `PUT` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:39.200738 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e83120-3a5f-458d-92ec-7f0d41e68cac None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:39.201027 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e83120-3a5f-458d-92ec-7f0d41e68cac None admin] PATH_INFO: `/v3/projects/fe7cc05cd9f44d74a635079ef883d9a9/users/930b863db5db4586be6176c18a3bafd5/roles/e6933171244b410694fbc4f1d8cb0130` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:39.205835 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:39.222424 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e83120-3a5f-458d-92ec-7f0d41e68cac None admin] RBAC: Authorizing `identity:create_grant(project_id=fe7cc05cd9f44d74a635079ef883d9a9, user_id=930b863db5db4586be6176c18a3bafd5, role_id=e6933171244b410694fbc4f1d8cb0130)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:39.224419 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e83120-3a5f-458d-92ec-7f0d41e68cac None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:39.294665 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb544c6-b25b-4c4e-98b0-9903c46cdf4a None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:39.334279 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14413c29-c53c-445b-bab2-055563ea6fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:39.334927 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14413c29-c53c-445b-bab2-055563ea6fc3 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:39.335278 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14413c29-c53c-445b-bab2-055563ea6fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:39.335544 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14413c29-c53c-445b-bab2-055563ea6fc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:39.344277 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14413c29-c53c-445b-bab2-055563ea6fc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:39.346005 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14413c29-c53c-445b-bab2-055563ea6fc3 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:39.359331 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-14413c29-c53c-445b-bab2-055563ea6fc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:39:39.359331 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:39.359331 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:39.359331 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:39.359331 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:39.359331 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:39.359331 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:39.359331 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:39.359331 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:39.359331 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:39.359331 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:39.359331 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:39.359331 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:39:39.359331 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:39:39.359331 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:39:39.360460 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:39:39.360460 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:39.360460 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:39.360460 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:39.360460 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:39.360460 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:39.360460 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:39.360460 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:39.360460 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:39.360460 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:39.360460 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:39.360460 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:39.360460 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:39.360460 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:39.360460 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:39.360460 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:39.360460 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:39.362121 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:39:39.362121 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:39:39.362121 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:39:39.362121 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:39:39.362121 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:39:39.362121 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:39:39.362121 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:39:39.362121 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:39.362121 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 285/580] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:39:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:39.371109 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14413c29-c53c-445b-bab2-055563ea6fc3 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:39.379677 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 296/581] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 00:39:38 2022] PUT /identity/v3/projects/fe7cc05cd9f44d74a635079ef883d9a9/users/930b863db5db4586be6176c18a3bafd5/roles/e6933171244b410694fbc4f1d8cb0130 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:39.467057 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:39.500849 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14413c29-c53c-445b-bab2-055563ea6fc3 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:39.544460 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925e38c-21cc-4c2a-8b70-49e3a5cc1904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:39.545561 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925e38c-21cc-4c2a-8b70-49e3a5cc1904 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:39.546066 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925e38c-21cc-4c2a-8b70-49e3a5cc1904 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:39.546574 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925e38c-21cc-4c2a-8b70-49e3a5cc1904 None admin] PATH_INFO: `/v3/projects` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:39.547583 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925e38c-21cc-4c2a-8b70-49e3a5cc1904 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:39.548141 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925e38c-21cc-4c2a-8b70-49e3a5cc1904 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:39.550156 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925e38c-21cc-4c2a-8b70-49e3a5cc1904 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:39.565131 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 286/582] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 00:39:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:39.573437 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e83120-3a5f-458d-92ec-7f0d41e68cac None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:39.711805 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e83120-3a5f-458d-92ec-7f0d41e68cac None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:39.750720 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324c6e3-3955-4cf6-b0b3-90b183968281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:39.751420 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324c6e3-3955-4cf6-b0b3-90b183968281 None admin] REQUEST_METHOD: `PUT` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:39.751786 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324c6e3-3955-4cf6-b0b3-90b183968281 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:39.752086 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324c6e3-3955-4cf6-b0b3-90b183968281 None admin] PATH_INFO: `/v3/projects/fe7cc05cd9f44d74a635079ef883d9a9/users/85a98342482a4031b6d87cb1d0fbaea0/roles/e6933171244b410694fbc4f1d8cb0130` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:39.769265 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324c6e3-3955-4cf6-b0b3-90b183968281 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe7cc05cd9f44d74a635079ef883d9a9, user_id=85a98342482a4031b6d87cb1d0fbaea0, role_id=e6933171244b410694fbc4f1d8cb0130)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:39.770985 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324c6e3-3955-4cf6-b0b3-90b183968281 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:39.804005 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce321710-3c9e-4028-8d23-c41be1c2d2d8 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:39.804428 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce321710-3c9e-4028-8d23-c41be1c2d2d8 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:39.804825 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce321710-3c9e-4028-8d23-c41be1c2d2d8 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:39.809419 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 287/583] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:39.812747 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbcc0f-1ea7-4d05-a55f-b7b62863b2b8 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:39.813461 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbcc0f-1ea7-4d05-a55f-b7b62863b2b8 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:39.813983 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbcc0f-1ea7-4d05-a55f-b7b62863b2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:39.833588 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-02cbcc0f-1ea7-4d05-a55f-b7b62863b2b8 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:39.834902 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-02cbcc0f-1ea7-4d05-a55f-b7b62863b2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:39.868296 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 297/584] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 00:39:39 2022] PUT /identity/v3/projects/fe7cc05cd9f44d74a635079ef883d9a9/users/85a98342482a4031b6d87cb1d0fbaea0/roles/e6933171244b410694fbc4f1d8cb0130 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:39.930433 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 288/585] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:39:40.270907 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324c6e3-3955-4cf6-b0b3-90b183968281 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:40.310393 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:40.427503 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324c6e3-3955-4cf6-b0b3-90b183968281 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:40.470774 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9587cd6-6203-4a33-9ae2-f946df1fb90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:40.471436 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9587cd6-6203-4a33-9ae2-f946df1fb90c None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:40.471723 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9587cd6-6203-4a33-9ae2-f946df1fb90c None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:40.472001 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9587cd6-6203-4a33-9ae2-f946df1fb90c None admin] PATH_INFO: `/v3/roles/service` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:40.486294 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9587cd6-6203-4a33-9ae2-f946df1fb90c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:39:40.491284 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-b9587cd6-6203-4a33-9ae2-f946df1fb90c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:39:40.491284 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:40.491284 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:40.491284 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:40.491284 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:40.491284 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:40.491284 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:40.491284 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:40.491284 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:40.491284 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:40.491284 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:40.491284 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:40.491284 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:39:40.491284 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:39:40.491284 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:39:40.491284 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:39:40.492232 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:39:40.492232 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:39:40.492232 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:39:40.492232 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:39:40.492232 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:40.492232 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:40.492232 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:40.492232 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:40.492232 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:40.492232 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:40.492232 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:40.492232 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:40.492232 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:40.492232 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:40.492232 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:40.492232 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:40.493052 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:40.493052 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:40.493052 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:40.493052 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:40.493052 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:39:40.493052 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:39:40.493052 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:39:40.493052 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:39:40.493052 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:39:40.493052 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:39:40.493052 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:39:40.493052 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:40.493052 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 298/586] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 00:39:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:40.499515 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cbcc0f-1ea7-4d05-a55f-b7b62863b2b8 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:40.580752 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:40.639792 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cbcc0f-1ea7-4d05-a55f-b7b62863b2b8 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:40.691342 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d29cfe-1568-4af4-bad7-dbe891e13ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:40.692015 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d29cfe-1568-4af4-bad7-dbe891e13ec9 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:40.692341 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d29cfe-1568-4af4-bad7-dbe891e13ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:40.692621 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d29cfe-1568-4af4-bad7-dbe891e13ec9 None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:40.693358 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d29cfe-1568-4af4-bad7-dbe891e13ec9 None admin] RBAC: Adding query filter params (name=service) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:40.693762 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d29cfe-1568-4af4-bad7-dbe891e13ec9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:40.695204 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d29cfe-1568-4af4-bad7-dbe891e13ec9 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:40.706126 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 289/587] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 00:39:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:40.711863 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9587cd6-6203-4a33-9ae2-f946df1fb90c None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:40.819006 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:40.825106 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9587cd6-6203-4a33-9ae2-f946df1fb90c None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:40.864337 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f5fd0-9a14-4f43-8da7-a39d0280cd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:40.864896 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f5fd0-9a14-4f43-8da7-a39d0280cd3c None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:40.865175 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f5fd0-9a14-4f43-8da7-a39d0280cd3c None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:40.865542 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f5fd0-9a14-4f43-8da7-a39d0280cd3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:40.878363 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f5fd0-9a14-4f43-8da7-a39d0280cd3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:40.879876 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f5fd0-9a14-4f43-8da7-a39d0280cd3c None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:40.897976 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-af3f5fd0-9a14-4f43-8da7-a39d0280cd3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:40.897976 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:40.897976 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:40.897976 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:40.897976 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:40.897976 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:40.897976 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:40.897976 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:40.897976 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:40.897976 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:40.897976 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:40.897976 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:40.897976 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:39:40.897976 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:39:40.897976 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:39:40.897976 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:39:40.898999 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:40.898999 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:40.898999 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:40.898999 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:40.898999 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:40.898999 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:40.898999 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:40.898999 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:40.898999 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:40.898999 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:40.898999 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:40.898999 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:40.898999 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:40.898999 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:40.898999 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:40.898999 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:40.898999 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:39:40.900024 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:39:40.900024 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:40.900024 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:40.900024 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 299/588] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:40.906651 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d29cfe-1568-4af4-bad7-dbe891e13ec9 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:41.034978 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d29cfe-1568-4af4-bad7-dbe891e13ec9 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:41.070933 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:41.081224 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fab927-cca0-4f65-8330-55b4318f6e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:41.081952 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fab927-cca0-4f65-8330-55b4318f6e72 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:41.082236 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fab927-cca0-4f65-8330-55b4318f6e72 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:41.082510 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fab927-cca0-4f65-8330-55b4318f6e72 None admin] PATH_INFO: `/v3/domains` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:41.083168 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fab927-cca0-4f65-8330-55b4318f6e72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:41.083471 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fab927-cca0-4f65-8330-55b4318f6e72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:41.084944 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fab927-cca0-4f65-8330-55b4318f6e72 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:41.099392 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 290/589] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:41.107467 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f5fd0-9a14-4f43-8da7-a39d0280cd3c None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:41.219138 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba4095-abf2-41a4-b1f5-99a9d455b35f None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:41.219484 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba4095-abf2-41a4-b1f5-99a9d455b35f None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:41.219772 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba4095-abf2-41a4-b1f5-99a9d455b35f None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:41.221477 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 291/590] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:41.226699 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d176ff-38fb-4a47-9f32-7041633c5bed None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:41.226989 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d176ff-38fb-4a47-9f32-7041633c5bed None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:41.227263 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d176ff-38fb-4a47-9f32-7041633c5bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:41.247711 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-35d176ff-38fb-4a47-9f32-7041633c5bed None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:41.248948 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-35d176ff-38fb-4a47-9f32-7041633c5bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:41.296258 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f5fd0-9a14-4f43-8da7-a39d0280cd3c None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:41.343062 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 292/591] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:39:41.353946 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543e01d-b39f-4bfc-8b57-dfa45de72908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:41.354853 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543e01d-b39f-4bfc-8b57-dfa45de72908 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:41.357106 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543e01d-b39f-4bfc-8b57-dfa45de72908 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:41.357106 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543e01d-b39f-4bfc-8b57-dfa45de72908 None admin] PATH_INFO: `/v3/users/nova` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:41.366774 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543e01d-b39f-4bfc-8b57-dfa45de72908 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:41.369282 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543e01d-b39f-4bfc-8b57-dfa45de72908 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:41.393037 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-d543e01d-b39f-4bfc-8b57-dfa45de72908 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:39:41.393037 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:41.393037 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:41.393037 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:41.393037 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:41.393037 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:41.393037 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:41.393037 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:41.393037 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:41.393037 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:41.393037 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:41.393037 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:41.393037 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:39:41.393037 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:39:41.393037 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:39:41.393037 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:39:41.396166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:41.396166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:41.396166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:39:41.396166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:39:41.396166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:39:41.396166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:39:41.396166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:41.396166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:41.396166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:41.396166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:41.396166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:41.396166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:41.396166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:41.396166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:41.396166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:41.396166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:41.396166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:41.396166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:41.402729 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:41.402729 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:41.402729 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:39:41.402729 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:39:41.402729 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:39:41.402729 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:39:41.402729 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:39:41.402729 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:39:41.402729 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:39:41.402729 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:41.402729 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 300/592] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Aug 26 00:39:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:41.404800 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d176ff-38fb-4a47-9f32-7041633c5bed None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:41.535009 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d176ff-38fb-4a47-9f32-7041633c5bed None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:41.554638 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:41.574841 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba2bbf-5369-49ed-b653-48dd2e1a2bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:41.575497 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba2bbf-5369-49ed-b653-48dd2e1a2bc0 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:41.575801 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba2bbf-5369-49ed-b653-48dd2e1a2bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:41.576084 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba2bbf-5369-49ed-b653-48dd2e1a2bc0 None admin] PATH_INFO: `/v3/users` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:41.576851 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba2bbf-5369-49ed-b653-48dd2e1a2bc0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:41.577188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba2bbf-5369-49ed-b653-48dd2e1a2bc0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:41.578742 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba2bbf-5369-49ed-b653-48dd2e1a2bc0 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:41.599143 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 293/593] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Aug 26 00:39:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:41.605948 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543e01d-b39f-4bfc-8b57-dfa45de72908 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:41.619660 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:41.703886 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba2bbf-5369-49ed-b653-48dd2e1a2bc0 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:41.723866 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543e01d-b39f-4bfc-8b57-dfa45de72908 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:41.782655 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9e737-5d2f-479a-b547-1b3078a5e8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:41.783470 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9e737-5d2f-479a-b547-1b3078a5e8f2 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:41.783759 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9e737-5d2f-479a-b547-1b3078a5e8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:41.784618 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9e737-5d2f-479a-b547-1b3078a5e8f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:41.852875 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba2bbf-5369-49ed-b653-48dd2e1a2bc0 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:41.871840 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9e737-5d2f-479a-b547-1b3078a5e8f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:41.874115 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9e737-5d2f-479a-b547-1b3078a5e8f2 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:41.890326 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:41.897939 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410376e-a529-4ebc-a82d-2091e05a9172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:41.898647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410376e-a529-4ebc-a82d-2091e05a9172 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:41.899025 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410376e-a529-4ebc-a82d-2091e05a9172 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:41.899237 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410376e-a529-4ebc-a82d-2091e05a9172 None admin] PATH_INFO: `/v3/roles/service` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:41.916143 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410376e-a529-4ebc-a82d-2091e05a9172 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:39:41.921052 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-4410376e-a529-4ebc-a82d-2091e05a9172 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:39:41.921052 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:41.921052 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:41.921052 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:41.921052 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:41.921052 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:41.921052 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:41.921052 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:41.921052 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:41.921052 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:41.921052 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:41.921052 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:41.921052 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:39:41.921052 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:39:41.921052 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:39:41.921052 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:39:41.922025 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:39:41.922025 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:39:41.922025 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:39:41.922025 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:39:41.922025 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:41.922025 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:41.922025 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:41.922025 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:41.922025 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:41.922025 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:41.922025 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:41.922025 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:41.922025 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:41.922025 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:41.922025 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:41.922025 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:41.922843 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:41.922843 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:41.922843 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:41.922843 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:41.922843 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:39:41.922843 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:39:41.922843 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:39:41.922843 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:39:41.922843 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:39:41.922843 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:39:41.922843 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:39:41.922843 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:41.922843 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 294/594] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 00:39:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:41.924096 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42731f2-11db-4259-a0e4-fc477e0a2dad None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:41.924096 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42731f2-11db-4259-a0e4-fc477e0a2dad None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:41.924096 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42731f2-11db-4259-a0e4-fc477e0a2dad None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:41.928480 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 295/595] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:41.928480 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42731f2-11db-4259-a0e4-fc477e0a2dad None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:41.967398 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:42.013687 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 301/596] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:39:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:39:42.013687 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f716c-a543-4eaf-a5b0-4754a5ff7f1c None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:42.013687 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f716c-a543-4eaf-a5b0-4754a5ff7f1c None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:42.013687 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f716c-a543-4eaf-a5b0-4754a5ff7f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:42.030003 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-d24f716c-a543-4eaf-a5b0-4754a5ff7f1c None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:42.031216 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-d24f716c-a543-4eaf-a5b0-4754a5ff7f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:42.043921 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42731f2-11db-4259-a0e4-fc477e0a2dad None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:42.085665 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d53c8-a2aa-48b2-8eb9-bc6c25fbb4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:42.086295 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d53c8-a2aa-48b2-8eb9-bc6c25fbb4c6 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:42.086585 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d53c8-a2aa-48b2-8eb9-bc6c25fbb4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:42.086867 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d53c8-a2aa-48b2-8eb9-bc6c25fbb4c6 None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:42.087588 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d53c8-a2aa-48b2-8eb9-bc6c25fbb4c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:42.087901 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d53c8-a2aa-48b2-8eb9-bc6c25fbb4c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:42.089311 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d53c8-a2aa-48b2-8eb9-bc6c25fbb4c6 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:42.098431 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 296/597] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 00:39:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:42.099287 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d53c8-a2aa-48b2-8eb9-bc6c25fbb4c6 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:42.117652 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 302/598] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:39:42.118432 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f716c-a543-4eaf-a5b0-4754a5ff7f1c None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:42.167014 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:42.218044 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:42.225661 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d53c8-a2aa-48b2-8eb9-bc6c25fbb4c6 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:42.240424 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f716c-a543-4eaf-a5b0-4754a5ff7f1c None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:42.266785 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc6c78-b1b8-4f67-8ea2-ead3d09e4907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:42.267912 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc6c78-b1b8-4f67-8ea2-ead3d09e4907 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:42.268553 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc6c78-b1b8-4f67-8ea2-ead3d09e4907 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:42.269064 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc6c78-b1b8-4f67-8ea2-ead3d09e4907 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:42.281646 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae6526-abe5-4c46-a731-066ddce3e70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:42.282296 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae6526-abe5-4c46-a731-066ddce3e70c None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:42.282585 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae6526-abe5-4c46-a731-066ddce3e70c None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:42.282865 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae6526-abe5-4c46-a731-066ddce3e70c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:42.283852 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc6c78-b1b8-4f67-8ea2-ead3d09e4907 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:42.285974 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc6c78-b1b8-4f67-8ea2-ead3d09e4907 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:42.294933 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae6526-abe5-4c46-a731-066ddce3e70c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:42.296536 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae6526-abe5-4c46-a731-066ddce3e70c None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:42.303921 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-eecc6c78-b1b8-4f67-8ea2-ead3d09e4907 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:42.303921 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:42.303921 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:42.303921 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:42.303921 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:42.303921 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:42.303921 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:42.303921 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:42.303921 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:42.303921 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:42.303921 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:42.303921 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:42.303921 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:39:42.303921 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:39:42.303921 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:39:42.303921 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:39:42.304895 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:42.304895 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:42.304895 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:42.304895 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:42.304895 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:42.304895 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:42.304895 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:42.304895 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:42.304895 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:42.304895 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:42.304895 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:42.304895 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:42.304895 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:42.304895 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:42.304895 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:42.304895 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:42.304895 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:39:42.305820 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:39:42.305820 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:42.305820 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:42.308484 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 297/599] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:42.317557 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-20ae6526-abe5-4c46-a731-066ddce3e70c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:42.317557 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:42.317557 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:42.317557 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:42.317557 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:42.317557 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:42.317557 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:42.317557 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:42.317557 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:42.317557 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:42.317557 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:42.317557 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:42.317557 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:39:42.317557 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:39:42.317557 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:39:42.317557 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:39:42.318550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:42.318550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:42.318550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:42.318550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:42.318550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:42.318550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:42.318550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:42.318550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:42.318550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:42.318550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:42.318550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:42.318550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:42.318550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:42.318550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:42.318550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:42.318550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:42.318550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:39:42.319441 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:39:42.319441 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:42.319441 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:42.319608 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc6c78-b1b8-4f67-8ea2-ead3d09e4907 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:42.319681 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 303/600] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:42.324015 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae6526-abe5-4c46-a731-066ddce3e70c None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:42.438894 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:42.448732 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc6c78-b1b8-4f67-8ea2-ead3d09e4907 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:42.449923 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae6526-abe5-4c46-a731-066ddce3e70c None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:42.486074 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84034351-93aa-43f9-80ad-feedcf606af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:42.487136 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84034351-93aa-43f9-80ad-feedcf606af7 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:42.487602 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84034351-93aa-43f9-80ad-feedcf606af7 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:42.488157 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84034351-93aa-43f9-80ad-feedcf606af7 None admin] PATH_INFO: `/v3/domains` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:42.488349 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd39aa-63c8-4e78-ab58-1ba02d790fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:42.489029 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd39aa-63c8-4e78-ab58-1ba02d790fa8 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:42.489324 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd39aa-63c8-4e78-ab58-1ba02d790fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:42.489589 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84034351-93aa-43f9-80ad-feedcf606af7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:42.489689 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd39aa-63c8-4e78-ab58-1ba02d790fa8 None admin] PATH_INFO: `/v3/domains` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:42.490151 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84034351-93aa-43f9-80ad-feedcf606af7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:42.490297 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd39aa-63c8-4e78-ab58-1ba02d790fa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:42.490596 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd39aa-63c8-4e78-ab58-1ba02d790fa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:42.491991 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd39aa-63c8-4e78-ab58-1ba02d790fa8 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:42.492232 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84034351-93aa-43f9-80ad-feedcf606af7 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:42.506246 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 298/601] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:42.507389 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84034351-93aa-43f9-80ad-feedcf606af7 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:42.511583 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 304/602] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:42.512413 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd39aa-63c8-4e78-ab58-1ba02d790fa8 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:42.524022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:42.631184 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84034351-93aa-43f9-80ad-feedcf606af7 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:42.639548 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd39aa-63c8-4e78-ab58-1ba02d790fa8 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:42.669025 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce57ea6-3942-4e4d-9b93-32773d3c0f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:42.669690 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce57ea6-3942-4e4d-9b93-32773d3c0f77 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:42.670005 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce57ea6-3942-4e4d-9b93-32773d3c0f77 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:42.670286 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce57ea6-3942-4e4d-9b93-32773d3c0f77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:42.681329 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce57ea6-3942-4e4d-9b93-32773d3c0f77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:39:42.683670 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa2006-201a-452d-9bda-fc5be6dc000e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:42.684312 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa2006-201a-452d-9bda-fc5be6dc000e None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:42.684737 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa2006-201a-452d-9bda-fc5be6dc000e None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:42.684850 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa2006-201a-452d-9bda-fc5be6dc000e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:42.686319 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-1ce57ea6-3942-4e4d-9b93-32773d3c0f77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:39:42.686319 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:42.686319 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:42.686319 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:42.686319 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:42.686319 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:42.686319 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:42.686319 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:42.686319 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:42.686319 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:42.686319 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:42.686319 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:42.686319 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:39:42.686319 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:39:42.686319 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:39:42.686319 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:39:42.687306 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:39:42.687306 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:39:42.687306 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:39:42.687306 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:39:42.687306 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:42.687306 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:42.687306 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:42.687306 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:42.687306 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:42.687306 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:42.687306 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:42.687306 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:42.687306 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:42.687306 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:42.687306 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:42.687306 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:42.688131 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:42.688131 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:42.688131 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:42.688131 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:42.688131 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:39:42.688131 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:39:42.688131 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:39:42.688131 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:39:42.688131 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:39:42.688131 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:39:42.688131 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:39:42.688131 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:42.688131 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 299/603] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 00:39:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:42.688839 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce57ea6-3942-4e4d-9b93-32773d3c0f77 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:42.698404 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa2006-201a-452d-9bda-fc5be6dc000e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:42.699796 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa2006-201a-452d-9bda-fc5be6dc000e None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:42.712975 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-2daa2006-201a-452d-9bda-fc5be6dc000e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 00:39:42.712975 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:42.712975 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:42.712975 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:42.712975 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:42.712975 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:42.712975 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:42.712975 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:42.712975 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:42.712975 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:42.712975 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:42.712975 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:42.712975 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:39:42.712975 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:39:42.712975 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:39:42.712975 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:39:42.713985 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:42.713985 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:42.713985 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:39:42.713985 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:39:42.713985 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:39:42.713985 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:39:42.713985 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:42.713985 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:42.713985 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:42.713985 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:42.713985 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:42.713985 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:42.713985 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:42.713985 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:42.713985 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:42.713985 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:42.713985 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:42.713985 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:42.715069 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:42.715069 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:42.715069 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:39:42.715069 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:39:42.715069 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:39:42.715069 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:39:42.715069 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:39:42.715069 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:39:42.715069 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 00:39:42.715069 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:42.715069 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 305/604] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 00:39:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:42.715639 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0789e6-8314-4aa7-b3eb-a1e2a45f7298 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:42.715639 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0789e6-8314-4aa7-b3eb-a1e2a45f7298 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:42.716098 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0789e6-8314-4aa7-b3eb-a1e2a45f7298 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:42.719845 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 306/605] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:42.719845 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0789e6-8314-4aa7-b3eb-a1e2a45f7298 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:42.731495 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:42.764899 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:42.806965 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce57ea6-3942-4e4d-9b93-32773d3c0f77 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:42.829257 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0789e6-8314-4aa7-b3eb-a1e2a45f7298 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:42.846287 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103d049-1b69-49bc-b2e5-9bfd9cc0b40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:42.854343 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103d049-1b69-49bc-b2e5-9bfd9cc0b40b None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:42.854343 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103d049-1b69-49bc-b2e5-9bfd9cc0b40b None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:42.854343 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103d049-1b69-49bc-b2e5-9bfd9cc0b40b None admin] PATH_INFO: `/v3/projects/service` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:42.854343 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103d049-1b69-49bc-b2e5-9bfd9cc0b40b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:42.855715 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103d049-1b69-49bc-b2e5-9bfd9cc0b40b None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:42.864115 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310e0f9-c3e2-4bd0-a7d6-e053e1908aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:42.864708 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310e0f9-c3e2-4bd0-a7d6-e053e1908aaa None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:42.864987 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310e0f9-c3e2-4bd0-a7d6-e053e1908aaa None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:42.865257 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310e0f9-c3e2-4bd0-a7d6-e053e1908aaa None admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:42.865956 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310e0f9-c3e2-4bd0-a7d6-e053e1908aaa None admin] RBAC: Adding query filter params (name=service) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:42.866256 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310e0f9-c3e2-4bd0-a7d6-e053e1908aaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:42.867594 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-a103d049-1b69-49bc-b2e5-9bfd9cc0b40b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:39:42.867594 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:42.867594 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:42.867594 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:42.867594 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:42.867594 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:42.867594 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:42.867594 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:42.867594 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:42.867594 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:42.867594 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:42.867594 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:42.867594 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:39:42.867594 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:39:42.867594 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:39:42.868454 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:39:42.868454 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:42.868454 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:42.868454 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:42.868454 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:42.868454 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:42.868454 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:42.868454 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:42.868454 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:42.868454 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:42.868454 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:42.868454 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:42.868454 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:42.868454 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:42.868454 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:42.868454 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:42.868454 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:42.870255 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:39:42.870255 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:39:42.870255 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:39:42.870255 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:39:42.870255 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:39:42.870255 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:39:42.870255 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:39:42.870255 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:42.870692 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310e0f9-c3e2-4bd0-a7d6-e053e1908aaa None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:42.873674 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 300/606] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:39:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:42.874850 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103d049-1b69-49bc-b2e5-9bfd9cc0b40b None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:42.877278 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 307/607] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 00:39:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:42.878585 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bb04c-ca73-4065-b355-78139f839a41 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:42.878870 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bb04c-ca73-4065-b355-78139f839a41 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:42.879182 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bb04c-ca73-4065-b355-78139f839a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:42.898933 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-495bb04c-ca73-4065-b355-78139f839a41 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:42.900151 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-495bb04c-ca73-4065-b355-78139f839a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:42.979932 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 308/608] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:39:42.980731 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bb04c-ca73-4065-b355-78139f839a41 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:42.983166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:42.992143 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103d049-1b69-49bc-b2e5-9bfd9cc0b40b None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:43.032764 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:43.044163 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe73d1-7058-48f1-bb5c-3d8ba7ff4fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:43.045209 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe73d1-7058-48f1-bb5c-3d8ba7ff4fe0 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:43.045526 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe73d1-7058-48f1-bb5c-3d8ba7ff4fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:43.045805 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe73d1-7058-48f1-bb5c-3d8ba7ff4fe0 None admin] PATH_INFO: `/v3/users` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:43.046559 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe73d1-7058-48f1-bb5c-3d8ba7ff4fe0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:43.046877 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe73d1-7058-48f1-bb5c-3d8ba7ff4fe0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:43.048854 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe73d1-7058-48f1-bb5c-3d8ba7ff4fe0 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:43.076252 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 301/609] 10.222.0.20 () {56 vars in 1139 bytes} [Fri Aug 26 00:39:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:43.076252 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe73d1-7058-48f1-bb5c-3d8ba7ff4fe0 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:43.097794 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bb04c-ca73-4065-b355-78139f839a41 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:43.138852 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28f98f-70ab-4bef-adb1-fa1da9f30ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:43.139479 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28f98f-70ab-4bef-adb1-fa1da9f30ef8 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:43.139755 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28f98f-70ab-4bef-adb1-fa1da9f30ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:43.140026 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28f98f-70ab-4bef-adb1-fa1da9f30ef8 None admin] PATH_INFO: `/v3/projects` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:43.140854 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28f98f-70ab-4bef-adb1-fa1da9f30ef8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:43.141120 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28f98f-70ab-4bef-adb1-fa1da9f30ef8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:43.142562 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28f98f-70ab-4bef-adb1-fa1da9f30ef8 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:43.158182 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 309/610] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 00:39:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:43.158182 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28f98f-70ab-4bef-adb1-fa1da9f30ef8 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:43.202248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe73d1-7058-48f1-bb5c-3d8ba7ff4fe0 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:43.244091 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:43.252439 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5db5a8-c956-4d96-8d71-ef6436212a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:43.253241 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5db5a8-c956-4d96-8d71-ef6436212a71 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:43.254394 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5db5a8-c956-4d96-8d71-ef6436212a71 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:43.254683 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5db5a8-c956-4d96-8d71-ef6436212a71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:43.272678 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5db5a8-c956-4d96-8d71-ef6436212a71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:43.275799 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5db5a8-c956-4d96-8d71-ef6436212a71 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:43.286336 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28f98f-70ab-4bef-adb1-fa1da9f30ef8 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:43.295036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-df5db5a8-c956-4d96-8d71-ef6436212a71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:43.295036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:43.295036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:43.295036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:43.295036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:43.295036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:43.295036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:43.295036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:43.295036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:43.295036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:43.295036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:43.295036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:43.295036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:39:43.295036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:39:43.295036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:39:43.295036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:39:43.296354 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:43.296354 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:43.296354 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:43.296354 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:43.296354 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:43.296354 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:43.296354 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:43.296354 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:43.296354 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:43.296354 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:43.296354 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:43.296354 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:43.296354 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:43.296354 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:43.296354 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:43.296354 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:43.296354 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:39:43.297211 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:39:43.297211 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:43.297211 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:43.297211 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 302/611] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:43.297211 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5db5a8-c956-4d96-8d71-ef6436212a71 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:43.331657 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1f44e-d244-4c62-8c97-6410148ccfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:43.332270 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1f44e-d244-4c62-8c97-6410148ccfc7 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:43.332547 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1f44e-d244-4c62-8c97-6410148ccfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:43.332818 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1f44e-d244-4c62-8c97-6410148ccfc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:43.345397 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:43.412136 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1f44e-d244-4c62-8c97-6410148ccfc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:43.413765 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1f44e-d244-4c62-8c97-6410148ccfc7 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:43.418059 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5db5a8-c956-4d96-8d71-ef6436212a71 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:43.453589 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a46544-131d-4fa2-81bf-c125e4baed4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:43.454200 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a46544-131d-4fa2-81bf-c125e4baed4c None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:43.454482 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a46544-131d-4fa2-81bf-c125e4baed4c None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:43.454753 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a46544-131d-4fa2-81bf-c125e4baed4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:43.455485 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a46544-131d-4fa2-81bf-c125e4baed4c None admin] RBAC: Adding query filter params (role.id=e6933171244b410694fbc4f1d8cb0130, scope.project.id=fe7cc05cd9f44d74a635079ef883d9a9, user.id=02f74984033043ecabd28df33960a37c) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:43.455797 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a46544-131d-4fa2-81bf-c125e4baed4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:43.457249 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a46544-131d-4fa2-81bf-c125e4baed4c None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:43.464078 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 303/612] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 00:39:43 2022] GET /identity/v3/role_assignments?user.id=02f74984033043ecabd28df33960a37c&scope.project.id=fe7cc05cd9f44d74a635079ef883d9a9&role.id=e6933171244b410694fbc4f1d8cb0130 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:43.464933 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a46544-131d-4fa2-81bf-c125e4baed4c None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:43.481692 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:43.534096 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 310/613] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:39:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:39:43.534096 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1f44e-d244-4c62-8c97-6410148ccfc7 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:43.594592 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a46544-131d-4fa2-81bf-c125e4baed4c None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:43.596590 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:43.645089 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89527ecf-1965-4b30-9511-b1ea593acba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:43.645776 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89527ecf-1965-4b30-9511-b1ea593acba8 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:43.646003 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89527ecf-1965-4b30-9511-b1ea593acba8 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:43.646620 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89527ecf-1965-4b30-9511-b1ea593acba8 None admin] PATH_INFO: `/v3/domains` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:43.646931 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89527ecf-1965-4b30-9511-b1ea593acba8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:43.647236 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89527ecf-1965-4b30-9511-b1ea593acba8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:43.648616 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89527ecf-1965-4b30-9511-b1ea593acba8 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:43.663111 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 304/614] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:43.663935 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89527ecf-1965-4b30-9511-b1ea593acba8 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:43.677052 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1f44e-d244-4c62-8c97-6410148ccfc7 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:43.717953 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3baa7e-9ecb-4b2a-bb7a-10027067ff96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:43.718650 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3baa7e-9ecb-4b2a-bb7a-10027067ff96 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:43.718922 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3baa7e-9ecb-4b2a-bb7a-10027067ff96 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:43.719190 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3baa7e-9ecb-4b2a-bb7a-10027067ff96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:43.737804 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3baa7e-9ecb-4b2a-bb7a-10027067ff96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:39:43.744171 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-ef3baa7e-9ecb-4b2a-bb7a-10027067ff96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:39:43.744171 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:43.744171 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:43.744171 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:43.744171 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:43.744171 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:43.744171 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:43.744171 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:43.744171 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:43.744171 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:43.744171 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:43.744171 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:43.744171 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:39:43.744171 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:39:43.744171 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:39:43.744171 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:39:43.745075 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:39:43.745075 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:39:43.745075 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:39:43.745075 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:39:43.745075 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:43.745075 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:43.745075 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:43.745075 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:43.745075 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:43.745075 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:43.745075 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:43.745075 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:43.745075 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:43.745075 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:43.745075 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:43.745075 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:43.746078 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:43.746078 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:43.746078 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:43.746078 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:43.746078 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:39:43.746078 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:39:43.746078 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:39:43.746078 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:39:43.746078 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:39:43.746078 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:39:43.746078 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:39:43.746078 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:43.746078 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 311/615] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 00:39:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:43.746764 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3baa7e-9ecb-4b2a-bb7a-10027067ff96 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:43.776752 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:43.792481 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89527ecf-1965-4b30-9511-b1ea593acba8 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:43.827099 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2290af54-c24a-4bb4-a561-137274c53e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:43.827830 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290af54-c24a-4bb4-a561-137274c53e23 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:43.828182 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290af54-c24a-4bb4-a561-137274c53e23 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:43.828530 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290af54-c24a-4bb4-a561-137274c53e23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:43.839386 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2290af54-c24a-4bb4-a561-137274c53e23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:43.840851 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2290af54-c24a-4bb4-a561-137274c53e23 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:43.856640 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-2290af54-c24a-4bb4-a561-137274c53e23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:43.856640 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:43.856640 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:43.856640 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:43.856640 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:43.856640 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:43.856640 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:43.856640 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:43.856640 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:43.856640 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:43.856640 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:43.856640 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:43.856640 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:39:43.856640 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:39:43.856640 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:39:43.856640 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:39:43.857700 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:43.857700 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:43.857700 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:43.857700 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:43.857700 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:43.857700 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:43.857700 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:43.857700 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:43.857700 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:43.857700 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:43.857700 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:43.857700 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:43.857700 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:43.857700 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:43.857700 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:43.857700 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:43.857700 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:39:43.858586 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:39:43.858586 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:43.858586 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:43.858586 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 305/616] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:43.859333 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2290af54-c24a-4bb4-a561-137274c53e23 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:43.865979 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3baa7e-9ecb-4b2a-bb7a-10027067ff96 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:43.876545 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:43.919632 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b80934-772b-4621-be3a-2c61faeef8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:43.920533 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b80934-772b-4621-be3a-2c61faeef8af None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:43.920884 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b80934-772b-4621-be3a-2c61faeef8af None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:43.921088 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b80934-772b-4621-be3a-2c61faeef8af None admin] PATH_INFO: `/v3/users/glance` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:43.929777 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b80934-772b-4621-be3a-2c61faeef8af None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:43.932372 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b80934-772b-4621-be3a-2c61faeef8af None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:43.949824 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-f3b80934-772b-4621-be3a-2c61faeef8af None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 26 00:39:43.949824 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:43.949824 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:43.949824 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:43.949824 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:43.949824 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:43.949824 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:43.949824 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:43.949824 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:43.949824 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:43.949824 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:43.949824 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:43.949824 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:39:43.949824 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:39:43.949824 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:39:43.949824 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:39:43.951793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:43.951793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:43.951793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:39:43.951793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:39:43.951793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:39:43.951793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:39:43.951793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:43.951793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:43.951793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:43.951793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:43.951793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:43.951793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:43.951793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:43.951793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:43.951793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:43.951793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:43.951793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:43.951793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:43.953909 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:43.953909 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:43.953909 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:39:43.953909 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:39:43.953909 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:39:43.953909 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:39:43.953909 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:39:43.953909 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:39:43.953909 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 26 00:39:43.953909 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:43.953909 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 312/617] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:39:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:43.959159 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b80934-772b-4621-be3a-2c61faeef8af None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:43.997998 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2290af54-c24a-4bb4-a561-137274c53e23 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:44.036784 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270b9bc-7d9c-4d6a-85fc-95eadbe8039f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:44.037431 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270b9bc-7d9c-4d6a-85fc-95eadbe8039f None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:44.037728 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270b9bc-7d9c-4d6a-85fc-95eadbe8039f None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:44.038011 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270b9bc-7d9c-4d6a-85fc-95eadbe8039f None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:44.038698 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270b9bc-7d9c-4d6a-85fc-95eadbe8039f None admin] RBAC: Adding query filter params (name=service) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:44.039019 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270b9bc-7d9c-4d6a-85fc-95eadbe8039f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:44.040932 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270b9bc-7d9c-4d6a-85fc-95eadbe8039f None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:44.051309 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 306/618] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 00:39:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:44.052094 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270b9bc-7d9c-4d6a-85fc-95eadbe8039f None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:44.066117 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:44.086658 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b80934-772b-4621-be3a-2c61faeef8af None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:44.132674 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125d6bb-5287-427c-b613-5130196e09c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:44.133493 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125d6bb-5287-427c-b613-5130196e09c3 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:44.133874 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125d6bb-5287-427c-b613-5130196e09c3 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:44.134321 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125d6bb-5287-427c-b613-5130196e09c3 None admin] PATH_INFO: `/v3/domains` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:44.135150 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0125d6bb-5287-427c-b613-5130196e09c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:44.135598 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0125d6bb-5287-427c-b613-5130196e09c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:44.137090 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0125d6bb-5287-427c-b613-5130196e09c3 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:44.149730 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 313/619] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:44.150764 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125d6bb-5287-427c-b613-5130196e09c3 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:44.156431 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:44.182265 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270b9bc-7d9c-4d6a-85fc-95eadbe8039f None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:44.219644 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380d7eb-3006-4000-9f8b-aa49693e1b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:44.220622 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380d7eb-3006-4000-9f8b-aa49693e1b82 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:44.221071 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380d7eb-3006-4000-9f8b-aa49693e1b82 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:44.221354 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380d7eb-3006-4000-9f8b-aa49693e1b82 None admin] PATH_INFO: `/v3/users` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:44.222142 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380d7eb-3006-4000-9f8b-aa49693e1b82 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:44.222460 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380d7eb-3006-4000-9f8b-aa49693e1b82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:44.224150 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380d7eb-3006-4000-9f8b-aa49693e1b82 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:44.246096 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 307/620] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Aug 26 00:39:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:44.246961 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380d7eb-3006-4000-9f8b-aa49693e1b82 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:44.269944 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125d6bb-5287-427c-b613-5130196e09c3 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:44.307772 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c631a4d-e6ed-44d0-aae8-0e64f0eb00d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:44.308392 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c631a4d-e6ed-44d0-aae8-0e64f0eb00d9 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:44.308673 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c631a4d-e6ed-44d0-aae8-0e64f0eb00d9 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:44.308944 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c631a4d-e6ed-44d0-aae8-0e64f0eb00d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:44.319673 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c631a4d-e6ed-44d0-aae8-0e64f0eb00d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:44.321317 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c631a4d-e6ed-44d0-aae8-0e64f0eb00d9 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:44.324938 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:44.341994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-2c631a4d-e6ed-44d0-aae8-0e64f0eb00d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:44.341994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:44.341994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:44.341994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:44.341994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:44.341994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:44.341994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:44.341994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:44.341994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:44.341994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:44.341994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:44.341994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:44.341994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:39:44.341994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:39:44.341994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:39:44.341994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:39:44.351851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:44.351851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:44.351851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:44.351851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:44.351851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:44.351851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:44.351851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:44.351851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:44.351851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:44.351851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:44.351851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:44.351851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:44.351851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:44.351851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:44.351851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:44.351851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:44.351851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:39:44.355071 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:39:44.355071 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:44.355071 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:44.355071 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 314/621] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:44.355071 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c631a4d-e6ed-44d0-aae8-0e64f0eb00d9 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:44.383138 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380d7eb-3006-4000-9f8b-aa49693e1b82 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:44.425248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eef0c7-8663-468b-a74e-cbced6a19402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:44.425931 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eef0c7-8663-468b-a74e-cbced6a19402 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:44.426248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eef0c7-8663-468b-a74e-cbced6a19402 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:44.426561 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eef0c7-8663-468b-a74e-cbced6a19402 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:44.428652 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:44.434606 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eef0c7-8663-468b-a74e-cbced6a19402 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:44.436089 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eef0c7-8663-468b-a74e-cbced6a19402 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:44.448036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-47eef0c7-8663-468b-a74e-cbced6a19402 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:39:44.448036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:44.448036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:44.448036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:44.448036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:44.448036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:44.448036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:44.448036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:44.448036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:44.448036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:44.448036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:44.448036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:44.448036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:39:44.448036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:39:44.448036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:39:44.449163 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:39:44.449163 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:44.449163 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:44.449163 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:44.449163 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:44.449163 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:44.449163 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:44.449163 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:44.449163 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:44.449163 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:44.449163 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:44.449163 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:44.449163 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:44.449163 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:44.449163 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:44.449163 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:44.449163 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:44.450155 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:39:44.450155 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:39:44.450155 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:39:44.450155 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:39:44.450155 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:39:44.450155 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:39:44.450155 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:39:44.450155 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:44.450155 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 308/622] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:39:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:44.450155 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eef0c7-8663-468b-a74e-cbced6a19402 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:44.491894 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c631a4d-e6ed-44d0-aae8-0e64f0eb00d9 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:44.532758 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29492c-3a06-4e20-a21b-bb403ec4a5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:44.533513 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29492c-3a06-4e20-a21b-bb403ec4a5b9 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:44.533874 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29492c-3a06-4e20-a21b-bb403ec4a5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:44.534196 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29492c-3a06-4e20-a21b-bb403ec4a5b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:44.575986 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eef0c7-8663-468b-a74e-cbced6a19402 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:44.614443 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:44.617855 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1cbd1-852e-463a-896c-41dcd277e526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:44.618487 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1cbd1-852e-463a-896c-41dcd277e526 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:44.618487 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1cbd1-852e-463a-896c-41dcd277e526 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:44.619673 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1cbd1-852e-463a-896c-41dcd277e526 None admin] PATH_INFO: `/v3/domains` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:44.620560 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1cbd1-852e-463a-896c-41dcd277e526 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:44.621444 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1cbd1-852e-463a-896c-41dcd277e526 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:44.623278 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1cbd1-852e-463a-896c-41dcd277e526 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:44.627778 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29492c-3a06-4e20-a21b-bb403ec4a5b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:44.627778 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29492c-3a06-4e20-a21b-bb403ec4a5b9 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:44.638591 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 309/623] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:44.639689 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1cbd1-852e-463a-896c-41dcd277e526 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:44.701036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:44.744987 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 315/624] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:39:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:39:44.746558 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29492c-3a06-4e20-a21b-bb403ec4a5b9 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:44.756323 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1cbd1-852e-463a-896c-41dcd277e526 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:44.808896 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c4b97-1987-4d45-a6d0-b4c017a083b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:44.809558 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c4b97-1987-4d45-a6d0-b4c017a083b7 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:44.809846 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c4b97-1987-4d45-a6d0-b4c017a083b7 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:44.810126 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c4b97-1987-4d45-a6d0-b4c017a083b7 None admin] PATH_INFO: `/v3/projects` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:44.810838 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c4b97-1987-4d45-a6d0-b4c017a083b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:44.811149 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c4b97-1987-4d45-a6d0-b4c017a083b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:44.812606 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c4b97-1987-4d45-a6d0-b4c017a083b7 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:44.826223 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 310/625] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 00:39:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:44.827045 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c4b97-1987-4d45-a6d0-b4c017a083b7 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:44.869193 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:44.878373 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29492c-3a06-4e20-a21b-bb403ec4a5b9 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:44.917250 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90528e75-6603-4894-b79f-4a501ff446b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:44.917968 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90528e75-6603-4894-b79f-4a501ff446b8 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:44.918249 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90528e75-6603-4894-b79f-4a501ff446b8 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:44.918523 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90528e75-6603-4894-b79f-4a501ff446b8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:44.927370 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90528e75-6603-4894-b79f-4a501ff446b8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:44.928874 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90528e75-6603-4894-b79f-4a501ff446b8 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:44.945062 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-90528e75-6603-4894-b79f-4a501ff446b8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 00:39:44.945062 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:44.945062 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:44.945062 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:44.945062 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:44.945062 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:44.945062 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:44.945062 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:44.945062 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:44.945062 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:44.945062 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:44.945062 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:44.945062 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:39:44.945062 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:39:44.945062 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:39:44.945062 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:39:44.946048 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:44.946048 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:44.946048 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:39:44.946048 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:39:44.946048 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:39:44.946048 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:39:44.946048 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:44.946048 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:44.946048 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:44.946048 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:44.946048 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:44.946048 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:44.946048 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:44.946048 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:44.946048 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:44.946048 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:44.946048 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:44.946048 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:44.947565 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:44.947565 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:44.947565 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:39:44.947565 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:39:44.947565 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:39:44.947565 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:39:44.947565 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:39:44.947565 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:39:44.947565 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 00:39:44.947565 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:44.947565 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 316/626] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:39:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:44.947565 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90528e75-6603-4894-b79f-4a501ff446b8 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:44.958622 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c4b97-1987-4d45-a6d0-b4c017a083b7 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:44.975401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:44.998416 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d88acb-bfef-4946-a7f1-d1ce895491eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:44.999130 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d88acb-bfef-4946-a7f1-d1ce895491eb None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:44.999414 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d88acb-bfef-4946-a7f1-d1ce895491eb None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:44.999695 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d88acb-bfef-4946-a7f1-d1ce895491eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:45.012181 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d88acb-bfef-4946-a7f1-d1ce895491eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:45.013992 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d88acb-bfef-4946-a7f1-d1ce895491eb None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:45.030289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-e1d88acb-bfef-4946-a7f1-d1ce895491eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:45.030289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:45.030289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:45.030289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:45.030289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:45.030289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:45.030289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:45.030289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:45.030289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:45.030289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:45.030289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:45.030289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:45.030289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:39:45.030289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:39:45.030289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:39:45.030289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:39:45.031248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:45.031248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:45.031248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:45.031248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:45.031248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:45.031248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:45.031248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:45.031248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:45.031248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:45.031248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:45.031248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:45.031248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:45.031248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:45.031248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:45.031248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:45.031248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:45.031248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:39:45.032152 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:39:45.032152 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:45.032152 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:45.032152 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 311/627] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:45.032809 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d88acb-bfef-4946-a7f1-d1ce895491eb None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:45.072481 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90528e75-6603-4894-b79f-4a501ff446b8 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:45.114012 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14fc4c-37b1-471d-bacd-18e4db6fe7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:45.114618 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14fc4c-37b1-471d-bacd-18e4db6fe7c0 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:45.114985 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14fc4c-37b1-471d-bacd-18e4db6fe7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:45.115268 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14fc4c-37b1-471d-bacd-18e4db6fe7c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:45.116040 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14fc4c-37b1-471d-bacd-18e4db6fe7c0 None admin] RBAC: Adding query filter params (role.id=e6933171244b410694fbc4f1d8cb0130, scope.project.id=fe7cc05cd9f44d74a635079ef883d9a9, user.id=fd3d4bf8049a44749b6be1d565303176) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:45.116360 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14fc4c-37b1-471d-bacd-18e4db6fe7c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:45.117943 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14fc4c-37b1-471d-bacd-18e4db6fe7c0 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:45.125638 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 317/628] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 00:39:44 2022] GET /identity/v3/role_assignments?user.id=fd3d4bf8049a44749b6be1d565303176&scope.project.id=fe7cc05cd9f44d74a635079ef883d9a9&role.id=e6933171244b410694fbc4f1d8cb0130 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:45.126521 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14fc4c-37b1-471d-bacd-18e4db6fe7c0 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:45.163970 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:45.170973 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d88acb-bfef-4946-a7f1-d1ce895491eb None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:45.231219 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e788cb-8b63-4eb2-96f1-ff1fa7a10767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:45.232271 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e788cb-8b63-4eb2-96f1-ff1fa7a10767 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:45.232776 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e788cb-8b63-4eb2-96f1-ff1fa7a10767 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:45.233243 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e788cb-8b63-4eb2-96f1-ff1fa7a10767 None admin] PATH_INFO: `/v3/users` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:45.234271 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e788cb-8b63-4eb2-96f1-ff1fa7a10767 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:45.234737 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e788cb-8b63-4eb2-96f1-ff1fa7a10767 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:45.236393 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e788cb-8b63-4eb2-96f1-ff1fa7a10767 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:45.260234 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 312/629] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Aug 26 00:39:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:45.274185 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e788cb-8b63-4eb2-96f1-ff1fa7a10767 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:45.290054 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14fc4c-37b1-471d-bacd-18e4db6fe7c0 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:45.317713 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:45.343649 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340169f-2a03-4d4d-b01c-d9ea972dc3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:45.344275 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340169f-2a03-4d4d-b01c-d9ea972dc3df None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:45.344818 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340169f-2a03-4d4d-b01c-d9ea972dc3df None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:45.344818 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340169f-2a03-4d4d-b01c-d9ea972dc3df None admin] PATH_INFO: `/v3/domains` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:45.345496 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b340169f-2a03-4d4d-b01c-d9ea972dc3df None admin] RBAC: Adding query filter params (name=Default) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:45.345862 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b340169f-2a03-4d4d-b01c-d9ea972dc3df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:45.347386 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b340169f-2a03-4d4d-b01c-d9ea972dc3df None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:45.364984 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 318/630] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:45.372085 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340169f-2a03-4d4d-b01c-d9ea972dc3df None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:45.432760 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e788cb-8b63-4eb2-96f1-ff1fa7a10767 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:45.484228 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98229416-454b-4617-a9be-36feae62a676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:45.484989 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98229416-454b-4617-a9be-36feae62a676 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:45.485333 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98229416-454b-4617-a9be-36feae62a676 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:45.485697 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98229416-454b-4617-a9be-36feae62a676 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:45.487036 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:45.513046 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340169f-2a03-4d4d-b01c-d9ea972dc3df None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:45.554006 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d91133-ee6d-4e68-a89a-554be97dadf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:45.555073 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d91133-ee6d-4e68-a89a-554be97dadf7 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:45.555566 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d91133-ee6d-4e68-a89a-554be97dadf7 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:45.556104 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d91133-ee6d-4e68-a89a-554be97dadf7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:45.564953 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d91133-ee6d-4e68-a89a-554be97dadf7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:45.566819 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d91133-ee6d-4e68-a89a-554be97dadf7 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:45.581792 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-c3d91133-ee6d-4e68-a89a-554be97dadf7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:39:45.581792 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:45.581792 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:45.581792 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:45.581792 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:45.581792 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:45.581792 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:45.581792 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:45.581792 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:45.581792 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:45.581792 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:45.581792 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:45.581792 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:39:45.581792 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:39:45.581792 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:39:45.582748 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:39:45.582748 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:45.582748 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:45.582748 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:45.582748 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:45.582748 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:45.582748 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:45.582748 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:45.582748 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:45.582748 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:45.582748 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:45.582748 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:45.582748 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:45.582748 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:45.582748 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:45.582748 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:45.582748 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:45.583628 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:39:45.583628 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:39:45.583628 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:39:45.583628 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:39:45.583628 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:39:45.583628 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:39:45.583628 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:39:45.583628 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:45.585296 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98229416-454b-4617-a9be-36feae62a676 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:45.586383 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 319/631] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:39:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:45.590166 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98229416-454b-4617-a9be-36feae62a676 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:45.592152 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d91133-ee6d-4e68-a89a-554be97dadf7 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:45.620038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:45.714729 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 313/632] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:39:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:39:45.726538 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98229416-454b-4617-a9be-36feae62a676 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:45.747197 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d91133-ee6d-4e68-a89a-554be97dadf7 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:45.794107 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7d446-1852-453e-a7fe-0aee501f36b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:45.794793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7d446-1852-453e-a7fe-0aee501f36b8 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:45.795078 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7d446-1852-453e-a7fe-0aee501f36b8 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:45.795358 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7d446-1852-453e-a7fe-0aee501f36b8 None admin] PATH_INFO: `/v3/projects` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:45.796166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7d446-1852-453e-a7fe-0aee501f36b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:45.796488 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7d446-1852-453e-a7fe-0aee501f36b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:45.798017 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7d446-1852-453e-a7fe-0aee501f36b8 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:45.805952 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:45.817787 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 320/633] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 00:39:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:39:45.819440 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7d446-1852-453e-a7fe-0aee501f36b8 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:45.843849 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98229416-454b-4617-a9be-36feae62a676 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:45.873084 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:45.884864 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a804b49-fca3-4db2-b7f8-5870dbd9a70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:45.885635 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a804b49-fca3-4db2-b7f8-5870dbd9a70b None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:45.885927 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a804b49-fca3-4db2-b7f8-5870dbd9a70b None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:45.886222 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a804b49-fca3-4db2-b7f8-5870dbd9a70b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:45.897026 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a804b49-fca3-4db2-b7f8-5870dbd9a70b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:45.898623 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a804b49-fca3-4db2-b7f8-5870dbd9a70b None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:45.921563 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-8a804b49-fca3-4db2-b7f8-5870dbd9a70b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:45.921563 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:45.921563 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:45.921563 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:45.921563 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:45.921563 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:45.921563 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:45.921563 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:45.921563 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:45.921563 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:45.921563 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:45.921563 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:45.921563 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:39:45.921563 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:39:45.921563 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:39:45.921563 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:39:45.922826 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:45.922826 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:45.922826 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:45.922826 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:45.922826 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:45.922826 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:45.922826 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:45.922826 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:45.922826 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:45.922826 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:45.922826 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:45.922826 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:45.922826 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:45.922826 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:45.922826 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:45.922826 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:45.922826 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:39:45.923825 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:39:45.923825 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:45.923825 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:45.923825 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 314/634] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:45.924046 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769374d-d5c2-448e-9bd5-522756639027 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:45.924157 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769374d-d5c2-448e-9bd5-522756639027 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:45.924482 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769374d-d5c2-448e-9bd5-522756639027 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:45.929532 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 315/635] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:45.930639 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769374d-d5c2-448e-9bd5-522756639027 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:45.952852 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7d446-1852-453e-a7fe-0aee501f36b8 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:45.990002 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56d53b-6f7b-4681-96a4-bfd81ef07fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:45.990898 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56d53b-6f7b-4681-96a4-bfd81ef07fff None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:45.991337 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56d53b-6f7b-4681-96a4-bfd81ef07fff None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:45.991609 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56d53b-6f7b-4681-96a4-bfd81ef07fff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:45.992363 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56d53b-6f7b-4681-96a4-bfd81ef07fff None admin] RBAC: Adding query filter params (role.id=e6933171244b410694fbc4f1d8cb0130, scope.project.id=fe7cc05cd9f44d74a635079ef883d9a9, user.id=930b863db5db4586be6176c18a3bafd5) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:45.992673 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56d53b-6f7b-4681-96a4-bfd81ef07fff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:45.994575 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56d53b-6f7b-4681-96a4-bfd81ef07fff None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:46.002492 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 321/636] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 00:39:45 2022] GET /identity/v3/role_assignments?user.id=930b863db5db4586be6176c18a3bafd5&scope.project.id=fe7cc05cd9f44d74a635079ef883d9a9&role.id=e6933171244b410694fbc4f1d8cb0130 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:39:46.002492 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b37a8-011b-42e1-8239-71b369aa3b40 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:46.002492 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b37a8-011b-42e1-8239-71b369aa3b40 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:46.002952 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b37a8-011b-42e1-8239-71b369aa3b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:46.030699 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-6e1b37a8-011b-42e1-8239-71b369aa3b40 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:46.032118 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-6e1b37a8-011b-42e1-8239-71b369aa3b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:46.070409 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769374d-d5c2-448e-9bd5-522756639027 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:46.121951 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e084b-33de-4d78-8cdf-75fd8bfd73ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:46.121951 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e084b-33de-4d78-8cdf-75fd8bfd73ab None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:46.122292 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:46.122371 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e084b-33de-4d78-8cdf-75fd8bfd73ab None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:46.122371 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e084b-33de-4d78-8cdf-75fd8bfd73ab None admin] PATH_INFO: `/v3/domains` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:46.122371 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e084b-33de-4d78-8cdf-75fd8bfd73ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:46.122371 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e084b-33de-4d78-8cdf-75fd8bfd73ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:46.122610 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e084b-33de-4d78-8cdf-75fd8bfd73ab None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:46.138979 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 322/637] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:39:46.142932 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 316/638] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:46.151501 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b37a8-011b-42e1-8239-71b369aa3b40 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:46.272330 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b37a8-011b-42e1-8239-71b369aa3b40 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:46.318996 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed8493-7bee-4058-9c09-3557d3b4a094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:46.319665 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed8493-7bee-4058-9c09-3557d3b4a094 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:46.319950 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed8493-7bee-4058-9c09-3557d3b4a094 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:46.320226 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed8493-7bee-4058-9c09-3557d3b4a094 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:46.329121 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed8493-7bee-4058-9c09-3557d3b4a094 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:46.330697 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed8493-7bee-4058-9c09-3557d3b4a094 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:46.345588 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-67ed8493-7bee-4058-9c09-3557d3b4a094 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:39:46.345588 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:46.345588 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:46.345588 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:46.345588 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:46.345588 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:46.345588 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:46.345588 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:46.345588 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:46.345588 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:46.345588 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:46.345588 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:46.345588 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:39:46.345588 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:39:46.345588 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:39:46.346547 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:39:46.346547 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:46.346547 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:46.346547 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:46.346547 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:46.346547 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:46.346547 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:46.346547 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:46.346547 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:46.346547 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:46.346547 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:46.346547 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:46.346547 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:46.346547 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:46.346547 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:46.346547 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:46.346547 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:46.347679 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:39:46.347679 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:39:46.347679 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:39:46.347679 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:39:46.347679 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:39:46.347679 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:39:46.347679 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:39:46.347679 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:46.347679 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 323/639] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:39:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:46.352644 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e084b-33de-4d78-8cdf-75fd8bfd73ab None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:46.397174 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:46.470459 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e084b-33de-4d78-8cdf-75fd8bfd73ab None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:46.496691 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed8493-7bee-4058-9c09-3557d3b4a094 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:46.517088 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c1a44-c50a-4331-a592-b0db4c26f2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:46.517774 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c1a44-c50a-4331-a592-b0db4c26f2fa None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:46.518055 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c1a44-c50a-4331-a592-b0db4c26f2fa None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:46.518326 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c1a44-c50a-4331-a592-b0db4c26f2fa None admin] PATH_INFO: `/v3/projects` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:46.519103 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c1a44-c50a-4331-a592-b0db4c26f2fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:46.519423 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c1a44-c50a-4331-a592-b0db4c26f2fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:46.521197 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c1a44-c50a-4331-a592-b0db4c26f2fa None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:46.540214 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 317/640] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 00:39:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:46.541785 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c1a44-c50a-4331-a592-b0db4c26f2fa None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:46.599973 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:46.645038 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed8493-7bee-4058-9c09-3557d3b4a094 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:46.668321 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:46.676027 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c1a44-c50a-4331-a592-b0db4c26f2fa None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:46.686154 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca1b09-3c39-4917-9627-963c15ecb657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:46.688899 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca1b09-3c39-4917-9627-963c15ecb657 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:46.688899 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca1b09-3c39-4917-9627-963c15ecb657 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:46.688899 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca1b09-3c39-4917-9627-963c15ecb657 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:46.703320 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca1b09-3c39-4917-9627-963c15ecb657 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:39:46.709268 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-a1ca1b09-3c39-4917-9627-963c15ecb657 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:39:46.709268 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:46.709268 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:46.709268 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:46.709268 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:46.709268 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:46.709268 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:46.709268 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:46.709268 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:46.709268 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:46.709268 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:46.709268 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:46.709268 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:39:46.709268 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:39:46.709268 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:39:46.709268 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:39:46.710521 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:39:46.710521 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:39:46.710521 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:39:46.710521 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:39:46.710521 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:46.710521 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:46.710521 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:46.710521 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:46.710521 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:46.710521 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:46.710521 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:46.710521 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:46.710521 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:46.710521 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:46.710521 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:46.710521 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:46.711900 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:46.711900 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:46.711900 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:46.711900 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:46.711900 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:39:46.711900 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:39:46.711900 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:39:46.711900 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:39:46.711900 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:39:46.711900 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:39:46.711900 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:39:46.711900 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:46.711900 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 324/641] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 00:39:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:46.716823 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca1b09-3c39-4917-9627-963c15ecb657 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:46.734722 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2610ca3-0c2d-4c31-8078-ae70842763ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:46.736356 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2610ca3-0c2d-4c31-8078-ae70842763ce None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:46.737184 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2610ca3-0c2d-4c31-8078-ae70842763ce None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:46.737728 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2610ca3-0c2d-4c31-8078-ae70842763ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:46.739115 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2610ca3-0c2d-4c31-8078-ae70842763ce None admin] RBAC: Adding query filter params (role.id=e6933171244b410694fbc4f1d8cb0130, scope.project.id=fe7cc05cd9f44d74a635079ef883d9a9, user.id=85a98342482a4031b6d87cb1d0fbaea0) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:46.739875 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2610ca3-0c2d-4c31-8078-ae70842763ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:46.742691 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2610ca3-0c2d-4c31-8078-ae70842763ce None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:46.755098 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 318/642] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 00:39:46 2022] GET /identity/v3/role_assignments?user.id=85a98342482a4031b6d87cb1d0fbaea0&scope.project.id=fe7cc05cd9f44d74a635079ef883d9a9&role.id=e6933171244b410694fbc4f1d8cb0130 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:46.900849 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca1b09-3c39-4917-9627-963c15ecb657 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:46.926611 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:46.960303 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab069e-5890-49bd-8512-7685c727bd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:46.961417 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab069e-5890-49bd-8512-7685c727bd05 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:46.961944 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab069e-5890-49bd-8512-7685c727bd05 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:46.962483 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab069e-5890-49bd-8512-7685c727bd05 None admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:46.963507 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab069e-5890-49bd-8512-7685c727bd05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:46.964022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab069e-5890-49bd-8512-7685c727bd05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:46.965707 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab069e-5890-49bd-8512-7685c727bd05 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:46.976876 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 325/643] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:39:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:39:46.984822 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2610ca3-0c2d-4c31-8078-ae70842763ce None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:47.169843 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2610ca3-0c2d-4c31-8078-ae70842763ce None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:47.237883 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6da35-4274-47cd-8d33-14a428b554c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:47.238884 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6da35-4274-47cd-8d33-14a428b554c9 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:47.239372 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6da35-4274-47cd-8d33-14a428b554c9 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:47.239716 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6da35-4274-47cd-8d33-14a428b554c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:47.258242 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6da35-4274-47cd-8d33-14a428b554c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:47.261443 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6da35-4274-47cd-8d33-14a428b554c9 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:47.279469 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-02c6da35-4274-47cd-8d33-14a428b554c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:47.279469 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:47.279469 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:47.279469 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:47.279469 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:47.279469 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:47.279469 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:47.279469 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:47.279469 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:47.279469 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:47.279469 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:47.279469 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:47.279469 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:39:47.279469 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:39:47.279469 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:39:47.279469 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:39:47.281330 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:47.281330 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:47.281330 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:47.281330 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:47.281330 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:47.281330 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:47.281330 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:47.281330 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:47.281330 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:47.281330 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:47.281330 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:47.281330 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:47.281330 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:47.281330 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:47.281330 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:47.281330 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:47.281330 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:39:47.283206 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:39:47.283206 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:47.283206 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:47.283206 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 319/644] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:47.294656 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab069e-5890-49bd-8512-7685c727bd05 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:47.454608 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab069e-5890-49bd-8512-7685c727bd05 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:47.497836 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c7169-fb2b-4e8f-a85f-050589977aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:47.498367 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c7169-fb2b-4e8f-a85f-050589977aa7 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:47.498643 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c7169-fb2b-4e8f-a85f-050589977aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:47.498920 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c7169-fb2b-4e8f-a85f-050589977aa7 None admin] PATH_INFO: `/v3/domains` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:47.499589 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c7169-fb2b-4e8f-a85f-050589977aa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:47.499896 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c7169-fb2b-4e8f-a85f-050589977aa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:47.501302 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c7169-fb2b-4e8f-a85f-050589977aa7 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:47.515147 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 326/645] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:47.522453 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6da35-4274-47cd-8d33-14a428b554c9 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:47.540061 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:47.579048 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afaee9-a0b7-489a-935b-20597bf9159b None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:47.579485 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afaee9-a0b7-489a-935b-20597bf9159b None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:47.579644 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afaee9-a0b7-489a-935b-20597bf9159b None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:47.580998 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 327/646] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:39:47.586460 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc09ed9-0e4f-453d-8467-a20f2a98d2ff None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:47.587065 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc09ed9-0e4f-453d-8467-a20f2a98d2ff None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:47.587773 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc09ed9-0e4f-453d-8467-a20f2a98d2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:47.608893 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-cdc09ed9-0e4f-453d-8467-a20f2a98d2ff None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:47.610527 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-cdc09ed9-0e4f-453d-8467-a20f2a98d2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:47.644416 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:47.649892 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6da35-4274-47cd-8d33-14a428b554c9 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:47.699963 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d193a-8af5-40cf-a92f-cfaba6842ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:47.700891 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d193a-8af5-40cf-a92f-cfaba6842ec5 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:47.701042 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d193a-8af5-40cf-a92f-cfaba6842ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:47.701339 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d193a-8af5-40cf-a92f-cfaba6842ec5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:47.708379 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 328/647] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:39:47.710049 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d193a-8af5-40cf-a92f-cfaba6842ec5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:47.711789 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d193a-8af5-40cf-a92f-cfaba6842ec5 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:47.726170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-395d193a-8af5-40cf-a92f-cfaba6842ec5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:39:47.726170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:47.726170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:47.726170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:47.726170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:47.726170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:47.726170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:47.726170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:47.726170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:47.726170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:47.726170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:47.726170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:47.726170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:39:47.726170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:39:47.726170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:39:47.726170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:39:47.727178 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:47.727178 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:47.727178 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:39:47.727178 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:39:47.727178 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:39:47.727178 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:39:47.727178 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:47.727178 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:47.727178 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:47.727178 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:47.727178 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:47.727178 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:47.727178 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:47.727178 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:47.727178 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:47.727178 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:47.727178 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:47.727178 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:47.728680 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:47.728680 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:47.728680 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:39:47.728680 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:39:47.728680 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:39:47.728680 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:39:47.728680 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:39:47.728680 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:39:47.728680 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:39:47.728680 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:47.728680 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 320/648] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Aug 26 00:39:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:47.734273 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc09ed9-0e4f-453d-8467-a20f2a98d2ff None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:47.851502 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc09ed9-0e4f-453d-8467-a20f2a98d2ff None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:47.891506 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5da53-40d5-4d64-85a6-259588a18e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:47.892505 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5da53-40d5-4d64-85a6-259588a18e2f None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:47.893000 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5da53-40d5-4d64-85a6-259588a18e2f None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:47.893555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5da53-40d5-4d64-85a6-259588a18e2f None admin] PATH_INFO: `/v3/users` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:47.894509 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5da53-40d5-4d64-85a6-259588a18e2f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:47.895024 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5da53-40d5-4d64-85a6-259588a18e2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:47.896676 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5da53-40d5-4d64-85a6-259588a18e2f None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:47.930831 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 329/649] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Aug 26 00:39:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:39:47.937277 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d193a-8af5-40cf-a92f-cfaba6842ec5 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:48.030243 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:48.065645 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d193a-8af5-40cf-a92f-cfaba6842ec5 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:48.091232 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5da53-40d5-4d64-85a6-259588a18e2f None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:48.110787 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490665e9-70cb-45a2-85db-32a7f4e3e74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:48.111698 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490665e9-70cb-45a2-85db-32a7f4e3e74d None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:48.112144 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490665e9-70cb-45a2-85db-32a7f4e3e74d None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:48.113010 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490665e9-70cb-45a2-85db-32a7f4e3e74d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:48.127220 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:48.213602 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490665e9-70cb-45a2-85db-32a7f4e3e74d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:48.215302 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490665e9-70cb-45a2-85db-32a7f4e3e74d None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:48.226907 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5da53-40d5-4d64-85a6-259588a18e2f None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:48.272107 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11755b-0bf4-44bb-a2a4-cc71690e642e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:48.273355 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11755b-0bf4-44bb-a2a4-cc71690e642e None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:48.273860 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11755b-0bf4-44bb-a2a4-cc71690e642e None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:48.274544 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11755b-0bf4-44bb-a2a4-cc71690e642e None admin] PATH_INFO: `/v3/services/network` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:48.276127 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11755b-0bf4-44bb-a2a4-cc71690e642e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:48.277784 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11755b-0bf4-44bb-a2a4-cc71690e642e None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:48.294810 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-8b11755b-0bf4-44bb-a2a4-cc71690e642e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:39:48.294810 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:48.294810 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:39:48.294810 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:39:48.294810 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:39:48.294810 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:39:48.294810 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:39:48.294810 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:39:48.294810 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:39:48.294810 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:48.294810 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:39:48.294810 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:48.294810 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:48.294810 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:48.294810 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:48.294810 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:48.294810 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:48.295957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:48.295957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:48.295957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:48.295957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:48.295957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:48.295957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:48.295957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:39:48.295957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:39:48.295957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:39:48.295957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:39:48.295957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:48.295957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:48.295957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:48.295957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:48.295957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:48.295957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:48.296971 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:48.296971 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:48.296971 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:48.296971 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:48.296971 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:48.296971 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:48.296971 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:48.296971 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:48.296971 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:48.296971 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:48.296971 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:39:48.296971 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:39:48.296971 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:39:48.296971 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:48.304121 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 330/650] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:39:48 2022] GET /identity/v3/services/network => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:48.305497 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11755b-0bf4-44bb-a2a4-cc71690e642e None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:48.310036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:48.355135 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 321/651] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:39:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 00:39:48.356377 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490665e9-70cb-45a2-85db-32a7f4e3e74d None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:48.459732 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:48.484436 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11755b-0bf4-44bb-a2a4-cc71690e642e None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:48.491065 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490665e9-70cb-45a2-85db-32a7f4e3e74d None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:48.536460 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452d478-f87b-470a-81e4-5e2e76fb3260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:48.537295 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452d478-f87b-470a-81e4-5e2e76fb3260 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:48.537711 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452d478-f87b-470a-81e4-5e2e76fb3260 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:48.538124 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452d478-f87b-470a-81e4-5e2e76fb3260 None admin] PATH_INFO: `/v3/services` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:48.538891 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452d478-f87b-470a-81e4-5e2e76fb3260 None admin] RBAC: Adding query filter params (name=network) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:48.539290 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452d478-f87b-470a-81e4-5e2e76fb3260 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:48.541149 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452d478-f87b-470a-81e4-5e2e76fb3260 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:48.541695 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11291b8f-c7db-4354-a8b1-5b2d714b72fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:48.542548 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11291b8f-c7db-4354-a8b1-5b2d714b72fe None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:48.543128 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11291b8f-c7db-4354-a8b1-5b2d714b72fe None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:48.543549 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11291b8f-c7db-4354-a8b1-5b2d714b72fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:48.553576 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 331/652] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 26 00:39:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:48.554823 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452d478-f87b-470a-81e4-5e2e76fb3260 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:48.558606 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11291b8f-c7db-4354-a8b1-5b2d714b72fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:48.560643 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11291b8f-c7db-4354-a8b1-5b2d714b72fe None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:48.582861 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-11291b8f-c7db-4354-a8b1-5b2d714b72fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:48.582861 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:48.582861 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:48.582861 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:48.582861 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:48.582861 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:48.582861 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:48.582861 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:48.582861 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:48.582861 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:48.582861 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:48.582861 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:48.582861 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:39:48.582861 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:39:48.582861 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:39:48.582861 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:39:48.584401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:48.584401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:48.584401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:48.584401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:48.584401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:48.584401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:48.584401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:48.584401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:48.584401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:48.584401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:48.584401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:48.584401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:48.584401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:48.584401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:48.584401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:48.584401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:48.584401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:39:48.585397 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:39:48.585397 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:48.585397 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:48.593323 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 322/653] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:48.594822 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11291b8f-c7db-4354-a8b1-5b2d714b72fe None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:48.636328 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:48.721818 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452d478-f87b-470a-81e4-5e2e76fb3260 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:48.750720 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11291b8f-c7db-4354-a8b1-5b2d714b72fe None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:48.780295 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91f6ef-c44b-45ac-98f6-f480e1a5fa42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:48.781957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91f6ef-c44b-45ac-98f6-f480e1a5fa42 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:48.782780 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91f6ef-c44b-45ac-98f6-f480e1a5fa42 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:48.783575 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91f6ef-c44b-45ac-98f6-f480e1a5fa42 None admin] PATH_INFO: `/v3/services` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:48.785173 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91f6ef-c44b-45ac-98f6-f480e1a5fa42 None admin] RBAC: Adding query filter params (type=network) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:48.786099 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91f6ef-c44b-45ac-98f6-f480e1a5fa42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:48.789025 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91f6ef-c44b-45ac-98f6-f480e1a5fa42 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:48.797827 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fd057-771a-4927-9620-53d71306a988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:48.798451 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fd057-771a-4927-9620-53d71306a988 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:48.798806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fd057-771a-4927-9620-53d71306a988 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:48.799068 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fd057-771a-4927-9620-53d71306a988 None admin] PATH_INFO: `/v3/domains` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:48.800004 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fd057-771a-4927-9620-53d71306a988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:48.800311 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fd057-771a-4927-9620-53d71306a988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:48.801806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fd057-771a-4927-9620-53d71306a988 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:48.802394 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 332/654] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 26 00:39:48 2022] GET /identity/v3/services?type=network => generated 124 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:48.835932 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 323/655] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:48.843211 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91f6ef-c44b-45ac-98f6-f480e1a5fa42 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:48.863693 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:48.991914 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91f6ef-c44b-45ac-98f6-f480e1a5fa42 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:49.035044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29c937-d001-4844-a931-7a3539d64760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:49.035844 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29c937-d001-4844-a931-7a3539d64760 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:49.036219 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29c937-d001-4844-a931-7a3539d64760 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:49.036591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29c937-d001-4844-a931-7a3539d64760 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:49.048877 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29c937-d001-4844-a931-7a3539d64760 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:49.051812 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29c937-d001-4844-a931-7a3539d64760 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:49.064097 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-2d29c937-d001-4844-a931-7a3539d64760 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:39:49.064097 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:49.064097 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:49.064097 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:49.064097 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:49.064097 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:49.064097 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:49.064097 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:49.064097 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:49.064097 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:49.064097 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:49.064097 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:49.064097 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:39:49.064097 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:39:49.064097 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:39:49.065713 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:39:49.065713 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:49.065713 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:49.065713 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:49.065713 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:49.065713 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:49.065713 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:49.065713 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:49.065713 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:49.065713 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:49.065713 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:49.065713 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:49.065713 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:49.065713 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:49.065713 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:49.065713 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:49.065713 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:49.066912 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:39:49.066912 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:39:49.066912 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:39:49.066912 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:39:49.066912 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:39:49.066912 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:39:49.066912 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:39:49.066912 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:49.069314 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 333/656] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:39:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:49.075462 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fd057-771a-4927-9620-53d71306a988 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:49.247985 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:49.282185 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fd057-771a-4927-9620-53d71306a988 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:49.358961 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745dd21-cf18-4c78-a4bf-82b542404f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:49.360138 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745dd21-cf18-4c78-a4bf-82b542404f6d None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:49.360708 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745dd21-cf18-4c78-a4bf-82b542404f6d None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:49.361360 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745dd21-cf18-4c78-a4bf-82b542404f6d None admin] PATH_INFO: `/v3/projects` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:49.362781 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745dd21-cf18-4c78-a4bf-82b542404f6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:49.363419 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745dd21-cf18-4c78-a4bf-82b542404f6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:49.366327 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745dd21-cf18-4c78-a4bf-82b542404f6d None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:49.391686 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 324/657] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 00:39:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:39:49.398571 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29c937-d001-4844-a931-7a3539d64760 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:49.428004 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6aa1a0-517c-428d-b21c-39576bd903ec None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:49.428712 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6aa1a0-517c-428d-b21c-39576bd903ec None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:49.429184 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6aa1a0-517c-428d-b21c-39576bd903ec None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:49.431902 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 325/658] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:39:49.438108 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e46e5-a335-4579-a79e-a96bacebadd6 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:49.438717 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e46e5-a335-4579-a79e-a96bacebadd6 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:49.439231 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e46e5-a335-4579-a79e-a96bacebadd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:49.460863 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-0f4e46e5-a335-4579-a79e-a96bacebadd6 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:49.462733 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-0f4e46e5-a335-4579-a79e-a96bacebadd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:49.527649 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:49.561695 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29c937-d001-4844-a931-7a3539d64760 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:49.575351 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 326/659] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:39:49.615903 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa5833-3443-465c-ba88-43bce5195775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:49.616939 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa5833-3443-465c-ba88-43bce5195775 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:49.617400 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa5833-3443-465c-ba88-43bce5195775 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:49.617812 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa5833-3443-465c-ba88-43bce5195775 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:49.620078 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa5833-3443-465c-ba88-43bce5195775 None admin] RBAC: Adding query filter params (role.id=f13055bcebf847bf8b46160ded13810b, scope.project.id=fe7cc05cd9f44d74a635079ef883d9a9, user.id=02f74984033043ecabd28df33960a37c) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:49.620466 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa5833-3443-465c-ba88-43bce5195775 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:49.622221 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa5833-3443-465c-ba88-43bce5195775 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:49.630708 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 334/660] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 00:39:49 2022] GET /identity/v3/role_assignments?user.id=02f74984033043ecabd28df33960a37c&scope.project.id=fe7cc05cd9f44d74a635079ef883d9a9&role.id=f13055bcebf847bf8b46160ded13810b => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:49.901699 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a8bed-480e-4243-9d2d-7ac3e4830bcd None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:49.902046 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a8bed-480e-4243-9d2d-7ac3e4830bcd None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:49.902235 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a8bed-480e-4243-9d2d-7ac3e4830bcd None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:49.903929 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 327/661] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:49.910952 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a8bed-480e-4243-9d2d-7ac3e4830bcd None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:49.911642 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1977c68-bb5a-4c28-93ec-ca0bf8590605 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:49.912015 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1977c68-bb5a-4c28-93ec-ca0bf8590605 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:49.912298 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1977c68-bb5a-4c28-93ec-ca0bf8590605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:49.940430 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-b1977c68-bb5a-4c28-93ec-ca0bf8590605 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:49.941963 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-b1977c68-bb5a-4c28-93ec-ca0bf8590605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:50.006598 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:50.041269 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a8bed-480e-4243-9d2d-7ac3e4830bcd None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:50.041752 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 335/662] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:39:50.088399 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79939d14-47d9-4ac0-8f04-c101d2ec290a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:50.089867 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79939d14-47d9-4ac0-8f04-c101d2ec290a None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:50.089867 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79939d14-47d9-4ac0-8f04-c101d2ec290a None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:50.089867 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79939d14-47d9-4ac0-8f04-c101d2ec290a None admin] PATH_INFO: `/v3/services/image` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:50.090438 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79939d14-47d9-4ac0-8f04-c101d2ec290a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:50.091887 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79939d14-47d9-4ac0-8f04-c101d2ec290a None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:50.104994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-79939d14-47d9-4ac0-8f04-c101d2ec290a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:39:50.104994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:50.104994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:39:50.104994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:39:50.104994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:39:50.104994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:39:50.104994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:39:50.104994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:39:50.104994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:39:50.104994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:50.104994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:39:50.104994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:50.104994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:50.104994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:50.104994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:50.104994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:50.104994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:50.107057 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:50.107057 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:50.107057 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:50.107057 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:50.107057 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:50.107057 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:50.107057 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:39:50.107057 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:39:50.107057 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:39:50.107057 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:39:50.107057 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:50.107057 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:50.107057 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:50.107057 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:50.107057 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:50.107057 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:50.108741 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:50.108741 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:50.108741 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:50.108741 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:50.108741 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:50.108741 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:50.108741 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:50.108741 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:50.108741 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:50.108741 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:50.108741 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:39:50.108741 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:39:50.108741 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:39:50.108741 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:50.108741 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 328/663] 10.222.0.20 () {56 vars in 1105 bytes} [Fri Aug 26 00:39:49 2022] GET /identity/v3/services/image => generated 86 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:50.122465 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1977c68-bb5a-4c28-93ec-ca0bf8590605 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:50.256725 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:50.303279 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1977c68-bb5a-4c28-93ec-ca0bf8590605 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:50.341937 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064faa94-7a99-4401-8d1c-e64cafb62d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:50.342648 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064faa94-7a99-4401-8d1c-e64cafb62d09 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:50.343001 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064faa94-7a99-4401-8d1c-e64cafb62d09 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:50.343344 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064faa94-7a99-4401-8d1c-e64cafb62d09 None admin] PATH_INFO: `/v3/services` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:50.344058 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064faa94-7a99-4401-8d1c-e64cafb62d09 None admin] RBAC: Adding query filter params (name=image) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:50.344433 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064faa94-7a99-4401-8d1c-e64cafb62d09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:50.345905 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064faa94-7a99-4401-8d1c-e64cafb62d09 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:50.351311 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 336/664] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:50.357669 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79939d14-47d9-4ac0-8f04-c101d2ec290a None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:50.466529 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064faa94-7a99-4401-8d1c-e64cafb62d09 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:50.530794 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79939d14-47d9-4ac0-8f04-c101d2ec290a None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:50.588466 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f712f-d464-4a7c-818e-888bd7848907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:50.588466 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f712f-d464-4a7c-818e-888bd7848907 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:50.588466 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f712f-d464-4a7c-818e-888bd7848907 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:50.588466 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f712f-d464-4a7c-818e-888bd7848907 None admin] PATH_INFO: `/v3/services` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:50.590338 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f712f-d464-4a7c-818e-888bd7848907 None admin] RBAC: Adding query filter params (type=image) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:50.590494 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f712f-d464-4a7c-818e-888bd7848907 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:50.591909 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f712f-d464-4a7c-818e-888bd7848907 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:50.601502 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 329/665] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:50 2022] GET /identity/v3/services?type=image => generated 122 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:50.640220 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064faa94-7a99-4401-8d1c-e64cafb62d09 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:50.677612 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:50.686980 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51187d6-44a5-436e-8d3a-ff55c086b038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:50.690329 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51187d6-44a5-436e-8d3a-ff55c086b038 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:50.690329 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51187d6-44a5-436e-8d3a-ff55c086b038 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:50.690329 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51187d6-44a5-436e-8d3a-ff55c086b038 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:50.690329 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51187d6-44a5-436e-8d3a-ff55c086b038 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:50.691217 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51187d6-44a5-436e-8d3a-ff55c086b038 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:50.702044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-b51187d6-44a5-436e-8d3a-ff55c086b038 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:39:50.702044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:50.702044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:39:50.702044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:39:50.702044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:39:50.702044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:39:50.702044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:39:50.702044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:39:50.702044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:39:50.702044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:50.702044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:39:50.702044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:50.702044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:50.702044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:50.702044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:50.702044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:50.702044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:50.703094 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:50.703094 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:50.703094 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:50.703094 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:50.703094 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:50.703094 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:50.703094 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:39:50.703094 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:39:50.703094 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:39:50.703094 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:39:50.703094 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:50.703094 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:50.703094 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:50.703094 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:50.703094 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:50.703094 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:50.703909 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:50.703909 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:50.703909 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:50.703909 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:50.703909 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:50.703909 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:50.703909 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:50.703909 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:50.703909 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:50.703909 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:50.703909 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:39:50.703909 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:39:50.703909 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:39:50.703909 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:50.706538 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 337/666] 10.222.0.20 () {56 vars in 1129 bytes} [Fri Aug 26 00:39:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:50.713423 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f712f-d464-4a7c-818e-888bd7848907 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:50.720801 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:50.916168 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f712f-d464-4a7c-818e-888bd7848907 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:50.985874 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9892a1a-5db4-40b4-ac2c-8b08443e6a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:50.986922 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9892a1a-5db4-40b4-ac2c-8b08443e6a02 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:50.987403 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9892a1a-5db4-40b4-ac2c-8b08443e6a02 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:50.987882 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9892a1a-5db4-40b4-ac2c-8b08443e6a02 None admin] PATH_INFO: `/v3/services` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:50.989910 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9892a1a-5db4-40b4-ac2c-8b08443e6a02 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:50.990428 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9892a1a-5db4-40b4-ac2c-8b08443e6a02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:50.992982 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9892a1a-5db4-40b4-ac2c-8b08443e6a02 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:51.009504 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 330/667] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Aug 26 00:39:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:51.012207 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51187d6-44a5-436e-8d3a-ff55c086b038 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:51.158546 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51187d6-44a5-436e-8d3a-ff55c086b038 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:51.215694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d71829-5434-4a33-b4b1-df501ecec47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:51.216884 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d71829-5434-4a33-b4b1-df501ecec47c None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:51.217523 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d71829-5434-4a33-b4b1-df501ecec47c None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:51.218139 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d71829-5434-4a33-b4b1-df501ecec47c None admin] PATH_INFO: `/v3/services` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:51.219403 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d71829-5434-4a33-b4b1-df501ecec47c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:51.220090 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d71829-5434-4a33-b4b1-df501ecec47c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:51.222494 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d71829-5434-4a33-b4b1-df501ecec47c None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:51.231510 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 338/668] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Aug 26 00:39:51 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:51.444074 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438d71a-e511-456c-afd9-2669ed88a9b4 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:51.444615 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438d71a-e511-456c-afd9-2669ed88a9b4 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:51.445096 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438d71a-e511-456c-afd9-2669ed88a9b4 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:51.447933 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 331/669] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:51.458332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65c3c3-0da8-4165-a2f3-7d8c6e013747 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:51.458762 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65c3c3-0da8-4165-a2f3-7d8c6e013747 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:51.459159 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65c3c3-0da8-4165-a2f3-7d8c6e013747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:51.480945 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-5d65c3c3-0da8-4165-a2f3-7d8c6e013747 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:51.482200 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-5d65c3c3-0da8-4165-a2f3-7d8c6e013747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:51.552676 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:51.566688 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 339/670] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:39:51.977258 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438d71a-e511-456c-afd9-2669ed88a9b4 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:52.039456 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c4545-023f-4244-8101-d88650be488c None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:52.039805 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c4545-023f-4244-8101-d88650be488c None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:52.040025 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c4545-023f-4244-8101-d88650be488c None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:52.042460 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 340/671] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:39:52.049364 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830cded-be28-4967-93e2-18f10f0ad5fa None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:52.050019 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830cded-be28-4967-93e2-18f10f0ad5fa None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:52.050304 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830cded-be28-4967-93e2-18f10f0ad5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:52.069732 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:52.079137 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-b830cded-be28-4967-93e2-18f10f0ad5fa None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:52.085573 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-b830cded-be28-4967-93e2-18f10f0ad5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:52.128569 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438d71a-e511-456c-afd9-2669ed88a9b4 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:52.169558 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eefd3ba-5643-4b0b-aac7-339456ec452c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:52.175900 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 341/672] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 26 00:39:52.176416 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefd3ba-5643-4b0b-aac7-339456ec452c None admin] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:52.176416 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefd3ba-5643-4b0b-aac7-339456ec452c None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:52.176416 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefd3ba-5643-4b0b-aac7-339456ec452c None admin] PATH_INFO: `/v3/services` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:52.176416 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eefd3ba-5643-4b0b-aac7-339456ec452c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:52.177581 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eefd3ba-5643-4b0b-aac7-339456ec452c None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:52.310902 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 332/673] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 26 00:39:51 2022] POST /identity/v3/services => generated 240 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:52.587221 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830cded-be28-4967-93e2-18f10f0ad5fa None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:52.708142 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830cded-be28-4967-93e2-18f10f0ad5fa None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:52.739847 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:52.779368 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec973ec5-f11d-41d2-91ab-d88ded4e9ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:52.780030 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec973ec5-f11d-41d2-91ab-d88ded4e9ee9 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:52.780311 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec973ec5-f11d-41d2-91ab-d88ded4e9ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:52.780587 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec973ec5-f11d-41d2-91ab-d88ded4e9ee9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:52.793690 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec973ec5-f11d-41d2-91ab-d88ded4e9ee9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:39:52.799007 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-ec973ec5-f11d-41d2-91ab-d88ded4e9ee9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:39:52.799007 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:52.799007 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:52.799007 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:52.799007 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:52.799007 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:52.799007 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:52.799007 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:52.799007 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:52.799007 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:52.799007 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:52.799007 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:52.799007 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:39:52.799007 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:39:52.799007 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:39:52.799007 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:39:52.800309 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:39:52.800309 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:39:52.800309 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:39:52.800309 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:39:52.800309 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:52.800309 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:52.800309 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:52.800309 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:52.800309 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:52.800309 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:52.800309 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:52.800309 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:52.800309 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:52.800309 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:52.800309 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:52.800309 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:52.801152 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:52.801152 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:52.801152 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:52.801152 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:52.801152 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:39:52.801152 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:39:52.801152 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:39:52.801152 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:39:52.801152 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:39:52.801152 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:39:52.801152 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:39:52.801152 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:52.805737 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 342/674] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 00:39:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:52.811559 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eefd3ba-5643-4b0b-aac7-339456ec452c None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:52.935408 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eefd3ba-5643-4b0b-aac7-339456ec452c None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:52.970878 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:52.980028 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e52489-ce3e-4bb4-881c-bf326b2c9a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:52.980667 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e52489-ce3e-4bb4-881c-bf326b2c9a3c None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:52.980955 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e52489-ce3e-4bb4-881c-bf326b2c9a3c None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:52.990374 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e52489-ce3e-4bb4-881c-bf326b2c9a3c None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:52.990374 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e52489-ce3e-4bb4-881c-bf326b2c9a3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:52.990374 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e52489-ce3e-4bb4-881c-bf326b2c9a3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:52.990374 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e52489-ce3e-4bb4-881c-bf326b2c9a3c None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:52.995300 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 333/675] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:39:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:53.001272 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec973ec5-f11d-41d2-91ab-d88ded4e9ee9 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:53.122355 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec973ec5-f11d-41d2-91ab-d88ded4e9ee9 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:53.149610 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73cdafa-8ee2-44ee-a363-0e2b73fa65bc None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:53.149973 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73cdafa-8ee2-44ee-a363-0e2b73fa65bc None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:53.150160 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73cdafa-8ee2-44ee-a363-0e2b73fa65bc None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:53.152340 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 334/676] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:53.157793 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda21b74-5956-4003-a350-96a6f169f97e None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:53.158093 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda21b74-5956-4003-a350-96a6f169f97e None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:53.158350 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda21b74-5956-4003-a350-96a6f169f97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:53.166148 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff549a6-4769-4d52-b09f-7576cf82640e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:53.166814 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff549a6-4769-4d52-b09f-7576cf82640e None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:53.167098 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff549a6-4769-4d52-b09f-7576cf82640e None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:53.167373 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff549a6-4769-4d52-b09f-7576cf82640e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:53.178186 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-fda21b74-5956-4003-a350-96a6f169f97e None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:53.179418 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-fda21b74-5956-4003-a350-96a6f169f97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:53.179551 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff549a6-4769-4d52-b09f-7576cf82640e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:53.181942 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff549a6-4769-4d52-b09f-7576cf82640e None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:53.197694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-5ff549a6-4769-4d52-b09f-7576cf82640e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:53.197694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:53.197694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:53.197694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:53.197694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:53.197694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:53.197694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:53.197694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:53.197694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:53.197694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:53.197694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:53.197694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:53.197694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:39:53.197694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:39:53.197694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:39:53.197694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:39:53.199023 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:53.199023 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:53.199023 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:53.199023 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:53.199023 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:53.199023 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:53.199023 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:53.199023 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:53.199023 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:53.199023 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:53.199023 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:53.199023 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:53.199023 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:53.199023 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:53.199023 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:53.199023 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:53.199023 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:39:53.200046 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:39:53.200046 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:53.200046 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:53.200046 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 343/677] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:53.210839 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff549a6-4769-4d52-b09f-7576cf82640e None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:53.249913 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:53.270449 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 335/678] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:53 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:39:53.333160 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff549a6-4769-4d52-b09f-7576cf82640e None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:53.374954 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731b786-ad64-4849-bb07-142026b836a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:53.375869 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731b786-ad64-4849-bb07-142026b836a5 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:53.376316 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731b786-ad64-4849-bb07-142026b836a5 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:53.376750 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731b786-ad64-4849-bb07-142026b836a5 None admin] PATH_INFO: `/v3/domains` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:53.377603 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f731b786-ad64-4849-bb07-142026b836a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:53.378060 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f731b786-ad64-4849-bb07-142026b836a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:53.379598 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f731b786-ad64-4849-bb07-142026b836a5 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:53.392775 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 344/679] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:53.401622 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda21b74-5956-4003-a350-96a6f169f97e None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:53.530906 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda21b74-5956-4003-a350-96a6f169f97e None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:53.553354 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:53.573943 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e731a18-d98f-4483-a763-68b8b9518d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:53.574976 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e731a18-d98f-4483-a763-68b8b9518d1c None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:53.575438 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e731a18-d98f-4483-a763-68b8b9518d1c None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:53.575924 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e731a18-d98f-4483-a763-68b8b9518d1c None admin] PATH_INFO: `/v3/users/nova` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:53.585474 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e731a18-d98f-4483-a763-68b8b9518d1c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:53.588025 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e731a18-d98f-4483-a763-68b8b9518d1c None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:53.602443 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-7e731a18-d98f-4483-a763-68b8b9518d1c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:39:53.602443 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:53.602443 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:53.602443 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:53.602443 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:53.602443 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:53.602443 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:53.602443 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:53.602443 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:53.602443 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:53.602443 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:53.602443 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:53.602443 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:39:53.602443 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:39:53.602443 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:39:53.602443 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:39:53.604289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:53.604289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:53.604289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:39:53.604289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:39:53.604289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:39:53.604289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:39:53.604289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:53.604289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:53.604289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:53.604289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:53.604289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:53.604289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:53.604289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:53.604289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:53.604289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:53.604289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:53.604289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:53.604289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:53.605416 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:53.605416 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:53.605416 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:39:53.605416 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:39:53.605416 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:39:53.605416 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:39:53.605416 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:39:53.605416 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:39:53.605416 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:39:53.605416 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:53.614797 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 336/680] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Aug 26 00:39:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:53.617125 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731b786-ad64-4849-bb07-142026b836a5 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:53.621337 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e731a18-d98f-4483-a763-68b8b9518d1c None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:53.730452 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:53.746116 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731b786-ad64-4849-bb07-142026b836a5 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:53.798633 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e731a18-d98f-4483-a763-68b8b9518d1c None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:53.804942 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc99a8f-92a8-43e5-8dfa-caf39442f008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:53.806110 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc99a8f-92a8-43e5-8dfa-caf39442f008 None admin] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:53.806610 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc99a8f-92a8-43e5-8dfa-caf39442f008 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:53.807118 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc99a8f-92a8-43e5-8dfa-caf39442f008 None admin] PATH_INFO: `/v3/services` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:53.808355 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc99a8f-92a8-43e5-8dfa-caf39442f008 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:53.811144 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc99a8f-92a8-43e5-8dfa-caf39442f008 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:53.843208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192da169-9656-4d0f-b83b-6596b5c453df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:53.844142 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192da169-9656-4d0f-b83b-6596b5c453df None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:53.844142 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192da169-9656-4d0f-b83b-6596b5c453df None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:53.844470 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192da169-9656-4d0f-b83b-6596b5c453df None admin] PATH_INFO: `/v3/users` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:53.845129 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192da169-9656-4d0f-b83b-6596b5c453df None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:53.845482 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192da169-9656-4d0f-b83b-6596b5c453df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:53.846961 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192da169-9656-4d0f-b83b-6596b5c453df None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:53.868060 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 337/681] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Aug 26 00:39:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:39:53.868745 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f51bf-0756-4a4d-9fda-bac5192873fc None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:53.868994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f51bf-0756-4a4d-9fda-bac5192873fc None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:53.870142 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f51bf-0756-4a4d-9fda-bac5192873fc None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:53.875349 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 338/682] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:53.875349 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f51bf-0756-4a4d-9fda-bac5192873fc None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:53.900489 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 345/683] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 26 00:39:53 2022] POST /identity/v3/services => generated 242 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:53.905836 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d3da6-65cf-44cf-a478-0fd7906be336 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:53.905836 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d3da6-65cf-44cf-a478-0fd7906be336 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:53.905836 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d3da6-65cf-44cf-a478-0fd7906be336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:53.929616 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-671d3da6-65cf-44cf-a478-0fd7906be336 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:53.931449 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-671d3da6-65cf-44cf-a478-0fd7906be336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:53.950710 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:54.032022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 346/684] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:53 2022] POST /identity/v3/auth/tokens => generated 994 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:39:54.098779 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f51bf-0756-4a4d-9fda-bac5192873fc None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:54.152542 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abad2ad-32ef-409b-814c-a1544b0c9e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:54.153300 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abad2ad-32ef-409b-814c-a1544b0c9e43 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:54.153617 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abad2ad-32ef-409b-814c-a1544b0c9e43 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:54.153896 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abad2ad-32ef-409b-814c-a1544b0c9e43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:54.166769 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abad2ad-32ef-409b-814c-a1544b0c9e43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:54.168319 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abad2ad-32ef-409b-814c-a1544b0c9e43 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:54.186104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-0abad2ad-32ef-409b-814c-a1544b0c9e43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:54.186104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:54.186104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:54.186104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:54.186104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:54.186104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:54.186104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:54.186104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:54.186104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:54.186104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:54.186104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:54.186104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:54.186104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:39:54.186104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:39:54.186104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:39:54.186104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:39:54.187136 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:54.187136 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:54.187136 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:54.187136 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:54.187136 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:54.187136 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:54.187136 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:54.187136 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:54.187136 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:54.187136 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:54.187136 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:54.187136 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:54.187136 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:54.187136 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:54.187136 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:54.187136 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:54.187136 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:39:54.188191 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:39:54.188191 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:54.188191 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:54.188191 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 339/685] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:39:54.193612 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d3da6-65cf-44cf-a478-0fd7906be336 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:54.379464 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abad2ad-32ef-409b-814c-a1544b0c9e43 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:54.480662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:54.484386 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:54.502178 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abad2ad-32ef-409b-814c-a1544b0c9e43 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:54.520724 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d3da6-65cf-44cf-a478-0fd7906be336 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:54.558959 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9d617-9e17-4d80-8540-8cdd010b7b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:54.559675 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9d617-9e17-4d80-8540-8cdd010b7b37 None admin] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:54.560002 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9d617-9e17-4d80-8540-8cdd010b7b37 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:54.560304 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9d617-9e17-4d80-8540-8cdd010b7b37 None admin] PATH_INFO: `/v3/services` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:54.561036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9d617-9e17-4d80-8540-8cdd010b7b37 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:54.562490 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9d617-9e17-4d80-8540-8cdd010b7b37 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:54.564511 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f46b6d-e16c-41d7-84b0-cc3a01709551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:54.565477 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f46b6d-e16c-41d7-84b0-cc3a01709551 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:54.565970 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f46b6d-e16c-41d7-84b0-cc3a01709551 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:54.566465 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f46b6d-e16c-41d7-84b0-cc3a01709551 None admin] PATH_INFO: `/v3/domains` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:54.567340 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f46b6d-e16c-41d7-84b0-cc3a01709551 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:54.567852 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f46b6d-e16c-41d7-84b0-cc3a01709551 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:54.569484 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f46b6d-e16c-41d7-84b0-cc3a01709551 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:54.583024 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 347/686] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:39:54.589332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f46b6d-e16c-41d7-84b0-cc3a01709551 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:54.650716 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 340/687] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 26 00:39:54 2022] POST /identity/v3/services => generated 251 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:54.730058 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f46b6d-e16c-41d7-84b0-cc3a01709551 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:54.802689 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4326a64-1cbb-4796-9900-500cf0b2e23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:54.804196 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4326a64-1cbb-4796-9900-500cf0b2e23f None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:54.804943 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4326a64-1cbb-4796-9900-500cf0b2e23f None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:54.805706 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4326a64-1cbb-4796-9900-500cf0b2e23f None admin] PATH_INFO: `/v3/projects/service` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:54.807993 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:54.818028 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d51f9a-c0eb-4635-8ef4-f1e16290484b None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:54.818332 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d51f9a-c0eb-4635-8ef4-f1e16290484b None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:54.821068 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d51f9a-c0eb-4635-8ef4-f1e16290484b None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:54.821068 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 341/688] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:54.822971 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4326a64-1cbb-4796-9900-500cf0b2e23f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:54.826154 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4326a64-1cbb-4796-9900-500cf0b2e23f None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:54.826771 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f555d-5b02-4dc3-947b-b7891ff42fcf None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:54.827099 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f555d-5b02-4dc3-947b-b7891ff42fcf None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:54.827399 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f555d-5b02-4dc3-947b-b7891ff42fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:54.848917 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-043f555d-5b02-4dc3-947b-b7891ff42fcf None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:54.850191 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-043f555d-5b02-4dc3-947b-b7891ff42fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:54.859733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-b4326a64-1cbb-4796-9900-500cf0b2e23f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:39:54.859733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:54.859733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:54.859733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:54.859733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:54.859733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:54.859733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:54.859733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:54.859733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:54.859733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:54.859733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:54.859733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:54.859733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:39:54.859733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:39:54.859733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:39:54.860680 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:39:54.860680 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:54.860680 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:54.860680 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:54.860680 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:54.860680 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:54.860680 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:54.860680 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:54.860680 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:54.860680 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:54.860680 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:54.860680 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:54.860680 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:54.860680 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:54.860680 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:54.860680 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:54.860680 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:54.861596 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:39:54.861596 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:39:54.861596 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:39:54.861596 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:39:54.861596 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:39:54.861596 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:39:54.861596 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:39:54.861596 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:54.862921 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 348/689] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:39:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:39:54.870082 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4326a64-1cbb-4796-9900-500cf0b2e23f None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:54.970151 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 342/690] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:54 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:39:55.014520 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4326a64-1cbb-4796-9900-500cf0b2e23f None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:55.054164 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da417ad7-d2f4-4b84-bfb8-f8525eb76200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:55.054778 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da417ad7-d2f4-4b84-bfb8-f8525eb76200 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:55.055058 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da417ad7-d2f4-4b84-bfb8-f8525eb76200 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:55.055333 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da417ad7-d2f4-4b84-bfb8-f8525eb76200 None admin] PATH_INFO: `/v3/projects` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:55.056238 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da417ad7-d2f4-4b84-bfb8-f8525eb76200 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:55.056627 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da417ad7-d2f4-4b84-bfb8-f8525eb76200 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:55.058387 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da417ad7-d2f4-4b84-bfb8-f8525eb76200 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:55.073149 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 349/691] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 00:39:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:55.082696 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f555d-5b02-4dc3-947b-b7891ff42fcf None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:55.180350 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:55.206850 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f555d-5b02-4dc3-947b-b7891ff42fcf None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:55.246615 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb9c94-79a5-4f20-adb0-06de9f493024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:55.247296 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb9c94-79a5-4f20-adb0-06de9f493024 None admin] REQUEST_METHOD: `PUT` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:55.247582 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb9c94-79a5-4f20-adb0-06de9f493024 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:55.247860 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb9c94-79a5-4f20-adb0-06de9f493024 None admin] PATH_INFO: `/v3/projects/fe7cc05cd9f44d74a635079ef883d9a9/users/02f74984033043ecabd28df33960a37c/roles/f13055bcebf847bf8b46160ded13810b` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:55.249947 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb9c94-79a5-4f20-adb0-06de9f493024 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe7cc05cd9f44d74a635079ef883d9a9, user_id=02f74984033043ecabd28df33960a37c, role_id=f13055bcebf847bf8b46160ded13810b)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:55.251463 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb9c94-79a5-4f20-adb0-06de9f493024 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:55.330248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 343/692] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 00:39:55 2022] PUT /identity/v3/projects/fe7cc05cd9f44d74a635079ef883d9a9/users/02f74984033043ecabd28df33960a37c/roles/f13055bcebf847bf8b46160ded13810b => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:55.335776 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da417ad7-d2f4-4b84-bfb8-f8525eb76200 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:55.411659 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:55.479504 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da417ad7-d2f4-4b84-bfb8-f8525eb76200 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:55.541215 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f789d8-cb8e-446d-9af3-4aa442bcd5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:55.541974 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f789d8-cb8e-446d-9af3-4aa442bcd5da None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:55.542258 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f789d8-cb8e-446d-9af3-4aa442bcd5da None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:55.542537 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f789d8-cb8e-446d-9af3-4aa442bcd5da None admin] PATH_INFO: `/v3/services/network` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:55.543137 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f789d8-cb8e-446d-9af3-4aa442bcd5da None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:55.544535 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f789d8-cb8e-446d-9af3-4aa442bcd5da None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:55.554683 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-01f789d8-cb8e-446d-9af3-4aa442bcd5da None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:39:55.554683 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:55.554683 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:39:55.554683 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:39:55.554683 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:39:55.554683 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:39:55.554683 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:39:55.554683 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:39:55.554683 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:39:55.554683 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:55.554683 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:39:55.554683 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:55.554683 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:55.554683 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:55.554683 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:55.554683 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:55.554683 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:55.556319 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:55.556319 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:55.556319 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:55.556319 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:55.556319 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:55.556319 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:55.556319 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:39:55.556319 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:39:55.556319 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:39:55.556319 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:39:55.556319 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:55.556319 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:55.556319 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:55.556319 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:55.556319 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:55.556319 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:55.557860 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:55.557860 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:55.557860 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:55.557860 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:55.557860 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:55.557860 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:55.557860 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:55.557860 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:55.557860 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:55.557860 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:55.557860 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:39:55.557860 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:39:55.557860 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:39:55.557860 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:55.557860 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 350/693] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:39:55 2022] GET /identity/v3/services/network => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:55.564251 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb9c94-79a5-4f20-adb0-06de9f493024 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:55.691800 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb9c94-79a5-4f20-adb0-06de9f493024 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:55.732333 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95ec1a-0dae-4f4f-99e3-5c24e08aee4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:55.732873 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95ec1a-0dae-4f4f-99e3-5c24e08aee4f None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:55.733582 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95ec1a-0dae-4f4f-99e3-5c24e08aee4f None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:55.733861 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95ec1a-0dae-4f4f-99e3-5c24e08aee4f None admin] PATH_INFO: `/v3/services` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:55.734516 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95ec1a-0dae-4f4f-99e3-5c24e08aee4f None admin] RBAC: Adding query filter params (name=network) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:55.734862 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95ec1a-0dae-4f4f-99e3-5c24e08aee4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:55.736392 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95ec1a-0dae-4f4f-99e3-5c24e08aee4f None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:55.742202 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 344/694] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 26 00:39:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:55.748392 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f789d8-cb8e-446d-9af3-4aa442bcd5da None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:55.870599 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f789d8-cb8e-446d-9af3-4aa442bcd5da None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:55.889101 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:55.924813 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a07b5-3761-4a62-9ec8-d07c6b828c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:55.925351 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a07b5-3761-4a62-9ec8-d07c6b828c4d None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:55.925880 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a07b5-3761-4a62-9ec8-d07c6b828c4d None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:55.926199 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a07b5-3761-4a62-9ec8-d07c6b828c4d None admin] PATH_INFO: `/v3/services` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:55.926961 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a07b5-3761-4a62-9ec8-d07c6b828c4d None admin] RBAC: Adding query filter params (type=network) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:55.927381 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a07b5-3761-4a62-9ec8-d07c6b828c4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:55.929263 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a07b5-3761-4a62-9ec8-d07c6b828c4d None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:55.940967 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 351/695] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 26 00:39:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:55.942485 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95ec1a-0dae-4f4f-99e3-5c24e08aee4f None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:55.948987 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:56.068184 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95ec1a-0dae-4f4f-99e3-5c24e08aee4f None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:56.108848 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae698f-0c7d-437a-a242-27ab132d442b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:56.109523 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae698f-0c7d-437a-a242-27ab132d442b None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:56.109807 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae698f-0c7d-437a-a242-27ab132d442b None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:56.110085 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae698f-0c7d-437a-a242-27ab132d442b None admin] PATH_INFO: `/v3/endpoints` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:56.110813 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae698f-0c7d-437a-a242-27ab132d442b None admin] RBAC: Adding query filter params (interface=public, service_id=a6357de9829c4a2d8a5beabd2cf7d4ea, region_id=RegionOne) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:56.111127 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae698f-0c7d-437a-a242-27ab132d442b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:56.112529 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae698f-0c7d-437a-a242-27ab132d442b None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:56.123504 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 345/696] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Aug 26 00:39:55 2022] GET /identity/v3/endpoints?service_id=a6357de9829c4a2d8a5beabd2cf7d4ea&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:56.128763 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a07b5-3761-4a62-9ec8-d07c6b828c4d None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:56.260109 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a07b5-3761-4a62-9ec8-d07c6b828c4d None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:56.299370 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eac63e-9313-4ae6-92bb-16f5d6a07fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:56.300299 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eac63e-9313-4ae6-92bb-16f5d6a07fe4 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:56.300582 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eac63e-9313-4ae6-92bb-16f5d6a07fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:56.300847 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eac63e-9313-4ae6-92bb-16f5d6a07fe4 None admin] PATH_INFO: `/v3/services` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:56.301545 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eac63e-9313-4ae6-92bb-16f5d6a07fe4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:56.303068 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eac63e-9313-4ae6-92bb-16f5d6a07fe4 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:56.311851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 352/697] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Aug 26 00:39:56 2022] GET /identity/v3/services => generated 1002 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:56.522586 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cdedd-40e1-4cd1-8825-a48b293075cf None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:56.523127 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cdedd-40e1-4cd1-8825-a48b293075cf None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:56.523585 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cdedd-40e1-4cd1-8825-a48b293075cf None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:56.525208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 346/698] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:56.531192 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892ee0a-4550-4d9a-b3ef-95de0fd70caa None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:56.531731 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892ee0a-4550-4d9a-b3ef-95de0fd70caa None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:56.531731 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892ee0a-4550-4d9a-b3ef-95de0fd70caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:56.552777 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-e892ee0a-4550-4d9a-b3ef-95de0fd70caa None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:56.554546 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-e892ee0a-4550-4d9a-b3ef-95de0fd70caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:56.608852 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:56.668271 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 353/699] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:56 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:39:57.033285 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1cdedd-40e1-4cd1-8825-a48b293075cf None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:57.112159 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:57.117530 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627900f-c7b6-48bb-ab45-e4a6212fe554 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:57.118201 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627900f-c7b6-48bb-ab45-e4a6212fe554 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:57.119473 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627900f-c7b6-48bb-ab45-e4a6212fe554 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:57.125363 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 354/700] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:57.128396 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12436a2b-ea78-4300-92fa-62b3417462a9 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:57.128396 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12436a2b-ea78-4300-92fa-62b3417462a9 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:57.128396 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12436a2b-ea78-4300-92fa-62b3417462a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:57.151576 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-12436a2b-ea78-4300-92fa-62b3417462a9 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:57.153188 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-12436a2b-ea78-4300-92fa-62b3417462a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:57.153731 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1cdedd-40e1-4cd1-8825-a48b293075cf None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:57.209159 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a131c31-8525-47f5-87bc-1705e4f947b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:57.209777 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a131c31-8525-47f5-87bc-1705e4f947b6 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:57.210101 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a131c31-8525-47f5-87bc-1705e4f947b6 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:57.210380 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a131c31-8525-47f5-87bc-1705e4f947b6 None admin] PATH_INFO: `/v3/services/image` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:57.210985 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a131c31-8525-47f5-87bc-1705e4f947b6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:57.212525 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a131c31-8525-47f5-87bc-1705e4f947b6 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:57.222750 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-6a131c31-8525-47f5-87bc-1705e4f947b6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:39:57.222750 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:57.222750 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:39:57.222750 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:39:57.222750 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:39:57.222750 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:39:57.222750 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:39:57.222750 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:39:57.222750 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:39:57.222750 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:57.222750 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:39:57.222750 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:57.222750 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:57.222750 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:57.222750 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:57.222750 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:57.222750 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:57.223822 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:57.223822 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:57.223822 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:57.223822 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:57.223822 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:57.223822 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:57.223822 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:39:57.223822 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:39:57.223822 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:39:57.223822 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:39:57.223822 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:57.223822 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:57.223822 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:57.223822 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:57.223822 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:57.223822 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:57.225104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:57.225104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:57.225104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:57.225104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:57.225104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:57.225104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:57.225104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:57.225104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:57.225104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:57.225104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:57.225104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:39:57.225104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:39:57.225104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:39:57.225104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:57.229122 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 347/701] 10.222.0.20 () {56 vars in 1105 bytes} [Fri Aug 26 00:39:57 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:57.230473 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a131c31-8525-47f5-87bc-1705e4f947b6 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:57.269136 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 355/702] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:57 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:39:57.352040 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a131c31-8525-47f5-87bc-1705e4f947b6 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:57.386108 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:57.393140 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ee725-b39e-49f4-9344-4f318ef972de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:57.394131 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ee725-b39e-49f4-9344-4f318ef972de None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:57.394650 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ee725-b39e-49f4-9344-4f318ef972de None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:57.395182 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ee725-b39e-49f4-9344-4f318ef972de None admin] PATH_INFO: `/v3/services` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:57.396069 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ee725-b39e-49f4-9344-4f318ef972de None admin] RBAC: Adding query filter params (name=image) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:57.396621 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ee725-b39e-49f4-9344-4f318ef972de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:57.398257 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ee725-b39e-49f4-9344-4f318ef972de None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:57.404783 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 348/703] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:57.410941 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12436a2b-ea78-4300-92fa-62b3417462a9 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:57.527296 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12436a2b-ea78-4300-92fa-62b3417462a9 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:57.529628 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:57.576458 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a302271-d71b-4d16-8766-47dedaad1b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:57.577133 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a302271-d71b-4d16-8766-47dedaad1b7b None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:57.577366 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a302271-d71b-4d16-8766-47dedaad1b7b None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:57.577706 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a302271-d71b-4d16-8766-47dedaad1b7b None admin] PATH_INFO: `/v3/services` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:57.578412 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a302271-d71b-4d16-8766-47dedaad1b7b None admin] RBAC: Adding query filter params (type=image) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:57.578721 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a302271-d71b-4d16-8766-47dedaad1b7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:57.580114 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a302271-d71b-4d16-8766-47dedaad1b7b None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:57.586141 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 356/704] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:57.592767 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ee725-b39e-49f4-9344-4f318ef972de None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:57.644290 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a302271-d71b-4d16-8766-47dedaad1b7b None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:57.739096 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ee725-b39e-49f4-9344-4f318ef972de None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:57.788944 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b390f5-66c0-493d-8569-fe2286359176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:57.789591 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b390f5-66c0-493d-8569-fe2286359176 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:57.789907 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b390f5-66c0-493d-8569-fe2286359176 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:57.790823 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b390f5-66c0-493d-8569-fe2286359176 None admin] PATH_INFO: `/v3/endpoints` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:57.791596 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b390f5-66c0-493d-8569-fe2286359176 None admin] RBAC: Adding query filter params (interface=public, service_id=2f0ec55c62494230b90dd94702563b8f, region_id=RegionOne) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:57.792097 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b390f5-66c0-493d-8569-fe2286359176 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:57.792653 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a302271-d71b-4d16-8766-47dedaad1b7b None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:57.793805 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b390f5-66c0-493d-8569-fe2286359176 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:57.803585 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 349/705] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Aug 26 00:39:57 2022] GET /identity/v3/endpoints?service_id=2f0ec55c62494230b90dd94702563b8f&interface=public®ion_id=RegionOne => generated 194 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:57.810709 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b390f5-66c0-493d-8569-fe2286359176 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:57.847521 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7f734-0139-4abe-b3e5-39b44bde9c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:57.848681 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7f734-0139-4abe-b3e5-39b44bde9c86 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:57.849511 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7f734-0139-4abe-b3e5-39b44bde9c86 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:57.850008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7f734-0139-4abe-b3e5-39b44bde9c86 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:57.851013 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7f734-0139-4abe-b3e5-39b44bde9c86 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:57.853831 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7f734-0139-4abe-b3e5-39b44bde9c86 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:57.864024 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-2bb7f734-0139-4abe-b3e5-39b44bde9c86 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:39:57.864024 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:57.864024 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:39:57.864024 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:39:57.864024 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:39:57.864024 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:39:57.864024 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:39:57.864024 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:39:57.864024 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:39:57.864024 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:57.864024 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:39:57.864024 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:57.864024 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:57.864024 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:57.864024 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:57.864024 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:57.864024 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:57.865055 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:57.865055 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:57.865055 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:57.865055 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:57.865055 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:57.865055 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:57.865055 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:39:57.865055 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:39:57.865055 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:39:57.865055 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:39:57.865055 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:57.865055 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:57.865055 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:57.865055 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:57.865055 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:57.865055 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:57.865981 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:57.865981 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:57.865981 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:57.865981 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:57.865981 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:57.865981 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:57.865981 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:57.865981 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:57.865981 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:57.865981 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:57.865981 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:39:57.865981 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:39:57.865981 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:39:57.865981 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:57.873519 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 357/706] 10.222.0.20 () {56 vars in 1129 bytes} [Fri Aug 26 00:39:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:39:57.876125 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7f734-0139-4abe-b3e5-39b44bde9c86 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:57.892914 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:57.916914 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:57.951580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b390f5-66c0-493d-8569-fe2286359176 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:57.996783 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb91a5-bb7a-4244-85e9-d31fb75cb97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:57.997584 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb91a5-bb7a-4244-85e9-d31fb75cb97d None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:57.997710 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb91a5-bb7a-4244-85e9-d31fb75cb97d None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:57.997982 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb91a5-bb7a-4244-85e9-d31fb75cb97d None admin] PATH_INFO: `/v3/services` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:57.998603 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb91a5-bb7a-4244-85e9-d31fb75cb97d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:58.000006 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb91a5-bb7a-4244-85e9-d31fb75cb97d None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:58.013404 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 350/707] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Aug 26 00:39:57 2022] GET /identity/v3/services => generated 1002 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:39:58.013606 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7f734-0139-4abe-b3e5-39b44bde9c86 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:58.013719 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59011de-f82d-470e-a098-8de0bbadf210 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:58.013719 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59011de-f82d-470e-a098-8de0bbadf210 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:58.013719 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59011de-f82d-470e-a098-8de0bbadf210 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:58.013719 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 351/708] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:58.015264 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8f688-26e0-46cc-a0d3-a2766198a4b8 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:58.015556 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8f688-26e0-46cc-a0d3-a2766198a4b8 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:58.015838 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8f688-26e0-46cc-a0d3-a2766198a4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:58.037480 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-a4e8f688-26e0-46cc-a0d3-a2766198a4b8 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:58.038833 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-a4e8f688-26e0-46cc-a0d3-a2766198a4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:58.073419 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5164607-4dbe-4ef1-aa41-2b9c8e184913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:58.074728 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5164607-4dbe-4ef1-aa41-2b9c8e184913 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:58.075778 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5164607-4dbe-4ef1-aa41-2b9c8e184913 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:58.076485 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5164607-4dbe-4ef1-aa41-2b9c8e184913 None admin] PATH_INFO: `/v3/services` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:58.077479 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5164607-4dbe-4ef1-aa41-2b9c8e184913 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:58.077957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5164607-4dbe-4ef1-aa41-2b9c8e184913 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:58.080669 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5164607-4dbe-4ef1-aa41-2b9c8e184913 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:58.089345 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 358/709] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Aug 26 00:39:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:39:58.095352 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5164607-4dbe-4ef1-aa41-2b9c8e184913 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:58.137589 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 352/710] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:58 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:39:58.219540 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:58.227011 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5164607-4dbe-4ef1-aa41-2b9c8e184913 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:58.265656 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a709bc-7932-4b0a-8c80-a4593eeda4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:58.266279 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a709bc-7932-4b0a-8c80-a4593eeda4f2 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:58.266613 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a709bc-7932-4b0a-8c80-a4593eeda4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:58.267023 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a709bc-7932-4b0a-8c80-a4593eeda4f2 None admin] PATH_INFO: `/v3/services` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:58.267961 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a709bc-7932-4b0a-8c80-a4593eeda4f2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:58.268505 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a709bc-7932-4b0a-8c80-a4593eeda4f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:58.271177 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a709bc-7932-4b0a-8c80-a4593eeda4f2 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:58.280610 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 359/711] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Aug 26 00:39:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:58.289093 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8f688-26e0-46cc-a0d3-a2766198a4b8 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:58.382960 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:58.476146 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8f688-26e0-46cc-a0d3-a2766198a4b8 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:58.480936 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a709bc-7932-4b0a-8c80-a4593eeda4f2 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:58.522346 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49465c-fbe3-4247-975c-19faf905317d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:58.523006 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49465c-fbe3-4247-975c-19faf905317d None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:58.523286 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49465c-fbe3-4247-975c-19faf905317d None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:58.523590 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49465c-fbe3-4247-975c-19faf905317d None admin] PATH_INFO: `/v3/endpoints` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:58.524331 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49465c-fbe3-4247-975c-19faf905317d None admin] RBAC: Adding query filter params (interface=public, service_id=0efb40867a5e4ab2aac25d6da0196f5c, region_id=RegionOne) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:58.524684 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49465c-fbe3-4247-975c-19faf905317d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:58.526327 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49465c-fbe3-4247-975c-19faf905317d None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:58.534866 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 353/712] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Aug 26 00:39:58 2022] GET /identity/v3/endpoints?service_id=0efb40867a5e4ab2aac25d6da0196f5c&interface=public®ion_id=RegionOne => generated 194 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:58.544219 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49465c-fbe3-4247-975c-19faf905317d None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:58.643203 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a709bc-7932-4b0a-8c80-a4593eeda4f2 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:58.684901 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2975898-a3db-4b2e-831a-9a2d2492f09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:58.686086 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2975898-a3db-4b2e-831a-9a2d2492f09b None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:58.686501 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2975898-a3db-4b2e-831a-9a2d2492f09b None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:58.686793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2975898-a3db-4b2e-831a-9a2d2492f09b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:58.701766 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2975898-a3db-4b2e-831a-9a2d2492f09b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:39:58.708759 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-f2975898-a3db-4b2e-831a-9a2d2492f09b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:39:58.708759 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:58.708759 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:58.708759 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:58.708759 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:58.708759 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:58.708759 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:58.708759 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:58.708759 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:58.708759 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:58.708759 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:58.708759 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:58.708759 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:39:58.708759 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:39:58.708759 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:39:58.708759 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:39:58.709952 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:39:58.709952 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:39:58.709952 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:39:58.709952 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:39:58.709952 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:58.709952 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:58.709952 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:58.709952 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:58.709952 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:58.709952 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:58.709952 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:58.709952 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:58.709952 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:58.709952 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:58.709952 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:58.709952 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:58.711258 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:58.711258 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:58.711258 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:58.711258 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:58.711258 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:39:58.711258 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:39:58.711258 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:39:58.711258 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:39:58.711258 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:39:58.711258 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:39:58.711258 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:39:58.711258 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:58.711258 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 360/713] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 00:39:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:58.713178 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f6b54-897c-44fb-b498-e58906955281 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:58.713178 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f6b54-897c-44fb-b498-e58906955281 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:58.714313 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f6b54-897c-44fb-b498-e58906955281 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:58.715147 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 361/714] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:39:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:58.719355 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f6b54-897c-44fb-b498-e58906955281 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:58.720703 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49465c-fbe3-4247-975c-19faf905317d None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:58.740608 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:58.747860 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:58.768341 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ac4af-db46-4523-8fb5-4badfbc59114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:58.769435 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ac4af-db46-4523-8fb5-4badfbc59114 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:58.769435 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ac4af-db46-4523-8fb5-4badfbc59114 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:58.769689 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ac4af-db46-4523-8fb5-4badfbc59114 None admin] PATH_INFO: `/v3/services` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:58.770202 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ac4af-db46-4523-8fb5-4badfbc59114 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:58.771802 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ac4af-db46-4523-8fb5-4badfbc59114 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:58.778488 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 354/715] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Aug 26 00:39:58 2022] GET /identity/v3/services => generated 1002 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:39:58.778488 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c69439-c801-485d-9da0-73f99e88f44f None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:58.778488 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c69439-c801-485d-9da0-73f99e88f44f None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:58.778488 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c69439-c801-485d-9da0-73f99e88f44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:58.804959 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-44c69439-c801-485d-9da0-73f99e88f44f None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:58.806321 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-44c69439-c801-485d-9da0-73f99e88f44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:58.885920 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f6b54-897c-44fb-b498-e58906955281 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:58.902172 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 355/716] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:39:58 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:39:58.931899 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aec8e5-18fa-4096-8497-f07f5bf8ae94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:58.932530 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aec8e5-18fa-4096-8497-f07f5bf8ae94 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:58.932813 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aec8e5-18fa-4096-8497-f07f5bf8ae94 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:58.933089 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aec8e5-18fa-4096-8497-f07f5bf8ae94 None admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:58.933904 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aec8e5-18fa-4096-8497-f07f5bf8ae94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:58.934227 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aec8e5-18fa-4096-8497-f07f5bf8ae94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:58.935644 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aec8e5-18fa-4096-8497-f07f5bf8ae94 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:58.946045 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 362/717] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:39:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:58.955250 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c69439-c801-485d-9da0-73f99e88f44f None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:59.073131 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c69439-c801-485d-9da0-73f99e88f44f None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:59.086208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:59.114168 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ced08-4bf4-464c-85f5-f2b165d1b362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:59.114810 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ced08-4bf4-464c-85f5-f2b165d1b362 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:59.115094 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ced08-4bf4-464c-85f5-f2b165d1b362 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:59.115371 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ced08-4bf4-464c-85f5-f2b165d1b362 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:59.127114 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ced08-4bf4-464c-85f5-f2b165d1b362 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:59.128614 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ced08-4bf4-464c-85f5-f2b165d1b362 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:59.148304 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-219ced08-4bf4-464c-85f5-f2b165d1b362 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:59.148304 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:59.148304 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:59.148304 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:59.148304 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:59.148304 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:59.148304 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:59.148304 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:59.148304 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:59.148304 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:59.148304 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:59.148304 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:59.148304 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:39:59.148304 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:39:59.148304 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:39:59.148304 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:39:59.150158 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:59.150158 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:59.150158 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:59.150158 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:59.150158 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:59.150158 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:59.150158 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:59.150158 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:59.150158 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:59.150158 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:59.150158 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:59.150158 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:59.150158 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:59.150158 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:59.150158 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:59.150158 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:59.150158 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:39:59.151066 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:39:59.151066 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:39:59.151066 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:59.151066 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 356/718] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:39:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:39:59.156174 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aec8e5-18fa-4096-8497-f07f5bf8ae94 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:59.257020 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:59.266043 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ced08-4bf4-464c-85f5-f2b165d1b362 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:59.281795 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aec8e5-18fa-4096-8497-f07f5bf8ae94 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:59.327813 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfeda98-cfb6-4e0b-b498-f457e90551d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:59.328586 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfeda98-cfb6-4e0b-b498-f457e90551d2 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:59.329004 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfeda98-cfb6-4e0b-b498-f457e90551d2 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:59.329281 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfeda98-cfb6-4e0b-b498-f457e90551d2 None admin] PATH_INFO: `/v3/domains` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:59.330238 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfeda98-cfb6-4e0b-b498-f457e90551d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:59.330551 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfeda98-cfb6-4e0b-b498-f457e90551d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:59.332719 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfeda98-cfb6-4e0b-b498-f457e90551d2 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:59.352041 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 363/719] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:59.358122 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfeda98-cfb6-4e0b-b498-f457e90551d2 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:59.394347 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ced08-4bf4-464c-85f5-f2b165d1b362 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:59.441895 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50beaed4-604f-447d-9afc-f5267a0223c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:59.442549 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50beaed4-604f-447d-9afc-f5267a0223c8 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:59.443460 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50beaed4-604f-447d-9afc-f5267a0223c8 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:59.443756 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50beaed4-604f-447d-9afc-f5267a0223c8 None admin] PATH_INFO: `/v3/services/network` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:59.444361 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50beaed4-604f-447d-9afc-f5267a0223c8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:59.446092 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50beaed4-604f-447d-9afc-f5267a0223c8 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:59.459208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-50beaed4-604f-447d-9afc-f5267a0223c8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:39:59.459208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:59.459208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:39:59.459208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:39:59.459208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:39:59.459208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:39:59.459208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:39:59.459208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:39:59.459208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:39:59.459208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:59.459208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:39:59.459208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:59.459208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:59.459208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:59.459208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:59.459208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:59.459208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:59.460343 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:59.460343 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:59.460343 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:59.460343 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:59.460343 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:59.460343 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:59.460343 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:39:59.460343 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:39:59.460343 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:39:59.460343 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:39:59.460343 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:59.460343 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:59.460343 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:59.460343 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:59.460343 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:59.460343 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:59.461179 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:59.461179 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:59.461179 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:59.461179 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:59.461179 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:59.461179 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:59.461179 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:59.461179 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:59.461179 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:59.461179 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:59.461179 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:39:59.461179 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:39:59.461179 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:39:59.461179 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:39:59.465472 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 357/720] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:39:59 2022] GET /identity/v3/services/network => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:39:59.469285 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50beaed4-604f-447d-9afc-f5267a0223c8 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:59.495191 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfeda98-cfb6-4e0b-b498-f457e90551d2 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:59.502048 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:59.539470 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67dbf53-99ef-4dd7-8c92-53aee8969ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:59.540653 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67dbf53-99ef-4dd7-8c92-53aee8969ea3 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:59.541105 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67dbf53-99ef-4dd7-8c92-53aee8969ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:59.541816 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67dbf53-99ef-4dd7-8c92-53aee8969ea3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:59.550702 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67dbf53-99ef-4dd7-8c92-53aee8969ea3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:59.552270 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67dbf53-99ef-4dd7-8c92-53aee8969ea3 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:59.555774 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:59.565751 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-a67dbf53-99ef-4dd7-8c92-53aee8969ea3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:39:59.565751 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:39:59.565751 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:39:59.565751 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:39:59.565751 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:39:59.565751 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:39:59.565751 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:39:59.565751 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:39:59.565751 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:39:59.565751 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:39:59.565751 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:39:59.565751 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:39:59.565751 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:39:59.565751 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:39:59.565751 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:39:59.565751 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:39:59.572694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:39:59.572694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:39:59.572694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:39:59.572694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:39:59.572694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:39:59.572694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:39:59.572694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:39:59.572694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:39:59.572694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:39:59.572694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:39:59.572694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:39:59.572694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:39:59.572694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:39:59.572694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:39:59.572694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:39:59.572694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:39:59.572694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:39:59.572694 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:39:59.573640 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:39:59.573640 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:39:59.573640 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:39:59.573640 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:39:59.573640 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:39:59.573640 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:39:59.573640 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:39:59.573640 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:39:59.573640 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:39:59.573640 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:39:59.573640 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 364/721] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Aug 26 00:39:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:39:59.573640 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67dbf53-99ef-4dd7-8c92-53aee8969ea3 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:59.603972 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50beaed4-604f-447d-9afc-f5267a0223c8 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:59.652111 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf893329-a8e7-4873-8acf-1138630abbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:59.653139 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf893329-a8e7-4873-8acf-1138630abbf9 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:59.653658 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf893329-a8e7-4873-8acf-1138630abbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:59.654317 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf893329-a8e7-4873-8acf-1138630abbf9 None admin] PATH_INFO: `/v3/services` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:59.655762 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf893329-a8e7-4873-8acf-1138630abbf9 None admin] RBAC: Adding query filter params (name=network) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:59.656368 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf893329-a8e7-4873-8acf-1138630abbf9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:59.658358 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf893329-a8e7-4873-8acf-1138630abbf9 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:59.666482 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 358/722] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 26 00:39:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:59.672346 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf893329-a8e7-4873-8acf-1138630abbf9 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:59.705285 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67dbf53-99ef-4dd7-8c92-53aee8969ea3 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:59.750110 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb20f3-5fd3-4d97-9d97-bf0ac3f775fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:59.751166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb20f3-5fd3-4d97-9d97-bf0ac3f775fb None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:59.751891 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb20f3-5fd3-4d97-9d97-bf0ac3f775fb None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:59.752365 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb20f3-5fd3-4d97-9d97-bf0ac3f775fb None admin] PATH_INFO: `/v3/users` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:59.754032 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb20f3-5fd3-4d97-9d97-bf0ac3f775fb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:59.754558 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb20f3-5fd3-4d97-9d97-bf0ac3f775fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:59.756291 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb20f3-5fd3-4d97-9d97-bf0ac3f775fb None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:59.782635 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 365/723] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Aug 26 00:39:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:59.788473 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb20f3-5fd3-4d97-9d97-bf0ac3f775fb None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:59.790577 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:59.804345 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf893329-a8e7-4873-8acf-1138630abbf9 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:59.849847 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ee2a7-339f-4400-9ee2-67856aa7a74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:59.850527 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ee2a7-339f-4400-9ee2-67856aa7a74a None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:59.850878 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ee2a7-339f-4400-9ee2-67856aa7a74a None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:59.851262 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ee2a7-339f-4400-9ee2-67856aa7a74a None admin] PATH_INFO: `/v3/services` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:59.851806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ee2a7-339f-4400-9ee2-67856aa7a74a None admin] RBAC: Adding query filter params (type=network) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:59.852117 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ee2a7-339f-4400-9ee2-67856aa7a74a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:59.853570 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ee2a7-339f-4400-9ee2-67856aa7a74a None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:59.863714 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 359/724] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 26 00:39:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:59.866299 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ee2a7-339f-4400-9ee2-67856aa7a74a None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:59.871435 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:59.934681 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb20f3-5fd3-4d97-9d97-bf0ac3f775fb None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:59.987947 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783ed68-1d2d-45d9-b9d6-f07c6bf21f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:59.989424 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783ed68-1d2d-45d9-b9d6-f07c6bf21f03 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:59.989864 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783ed68-1d2d-45d9-b9d6-f07c6bf21f03 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:59.990316 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783ed68-1d2d-45d9-b9d6-f07c6bf21f03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:59.991627 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ee2a7-339f-4400-9ee2-67856aa7a74a None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:00.038692 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc31854-a98f-4189-8ae8-5f408862e8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:00.039824 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc31854-a98f-4189-8ae8-5f408862e8d9 None admin] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:00.041243 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc31854-a98f-4189-8ae8-5f408862e8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:00.041724 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc31854-a98f-4189-8ae8-5f408862e8d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:00.043313 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc31854-a98f-4189-8ae8-5f408862e8d9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:00.044864 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc31854-a98f-4189-8ae8-5f408862e8d9 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:00.085084 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783ed68-1d2d-45d9-b9d6-f07c6bf21f03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:00.086632 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783ed68-1d2d-45d9-b9d6-f07c6bf21f03 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:00.149250 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:00.197499 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 366/725] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:39:59 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:40:00.203606 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783ed68-1d2d-45d9-b9d6-f07c6bf21f03 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:00.273964 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 360/726] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:59 2022] POST /identity/v3/endpoints => generated 337 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:40:00.328820 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783ed68-1d2d-45d9-b9d6-f07c6bf21f03 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:00.378100 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b6fe1-07f4-434d-8e1b-cd3f9ad556c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:00.378797 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b6fe1-07f4-434d-8e1b-cd3f9ad556c6 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:00.379083 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b6fe1-07f4-434d-8e1b-cd3f9ad556c6 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:00.379358 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b6fe1-07f4-434d-8e1b-cd3f9ad556c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:00.399072 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b6fe1-07f4-434d-8e1b-cd3f9ad556c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:00.401013 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b6fe1-07f4-434d-8e1b-cd3f9ad556c6 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:00.418984 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-110b6fe1-07f4-434d-8e1b-cd3f9ad556c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:40:00.418984 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:40:00.418984 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:40:00.418984 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:40:00.418984 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:40:00.418984 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:40:00.418984 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:40:00.418984 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:40:00.418984 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:40:00.418984 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:40:00.418984 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:40:00.418984 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:40:00.418984 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:40:00.418984 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:40:00.418984 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:40:00.418984 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:40:00.419965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:40:00.419965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:40:00.419965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:40:00.419965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:40:00.419965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:40:00.419965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:40:00.419965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:40:00.419965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:40:00.419965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:40:00.419965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:40:00.419965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:40:00.419965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:40:00.419965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:40:00.419965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:40:00.419965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:40:00.419965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:40:00.419965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:40:00.421251 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:40:00.421251 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:40:00.421251 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:40:00.421251 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 367/727] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:40:00.428204 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc31854-a98f-4189-8ae8-5f408862e8d9 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:00.445587 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:00.462243 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed224507-d1e7-43df-91ee-b45c95255f01 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:00.462622 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed224507-d1e7-43df-91ee-b45c95255f01 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:00.463019 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed224507-d1e7-43df-91ee-b45c95255f01 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:00.464627 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 368/728] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:40:00.470365 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8049ae-1233-4065-8400-a8646799712d None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:00.470695 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8049ae-1233-4065-8400-a8646799712d None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:00.470907 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8049ae-1233-4065-8400-a8646799712d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:00.486269 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:00.494192 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-bb8049ae-1233-4065-8400-a8646799712d None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:00.496254 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-bb8049ae-1233-4065-8400-a8646799712d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:00.553766 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc31854-a98f-4189-8ae8-5f408862e8d9 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:00.583392 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 369/729] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:40:00 2022] POST /identity/v3/auth/tokens => generated 1257 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:40:00.607316 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107058d-1a8e-4bd5-9d4f-4795f2d1d86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:00.607316 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107058d-1a8e-4bd5-9d4f-4795f2d1d86c None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:00.607316 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107058d-1a8e-4bd5-9d4f-4795f2d1d86c None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:00.607316 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107058d-1a8e-4bd5-9d4f-4795f2d1d86c None admin] PATH_INFO: `/v3/domains` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:00.608021 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107058d-1a8e-4bd5-9d4f-4795f2d1d86c None admin] RBAC: Adding query filter params (name=Default) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:00.608332 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107058d-1a8e-4bd5-9d4f-4795f2d1d86c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:00.611040 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107058d-1a8e-4bd5-9d4f-4795f2d1d86c None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:00.627241 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 361/730] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:40:00.631537 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8049ae-1233-4065-8400-a8646799712d None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:00.743993 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8049ae-1233-4065-8400-a8646799712d None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:00.783227 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08fdaf-eb11-42f7-8094-373eea45f33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:00.783874 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08fdaf-eb11-42f7-8094-373eea45f33d None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:00.784243 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08fdaf-eb11-42f7-8094-373eea45f33d None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:00.784439 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08fdaf-eb11-42f7-8094-373eea45f33d None admin] PATH_INFO: `/v3/projects/service` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:00.787605 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:00.793816 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08fdaf-eb11-42f7-8094-373eea45f33d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:00.795303 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08fdaf-eb11-42f7-8094-373eea45f33d None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:00.817197 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-9f08fdaf-eb11-42f7-8094-373eea45f33d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:40:00.817197 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:40:00.817197 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:40:00.817197 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:40:00.817197 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:40:00.817197 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:40:00.817197 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:40:00.817197 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:40:00.817197 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:40:00.817197 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:40:00.817197 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:40:00.817197 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:40:00.817197 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:40:00.817197 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:40:00.817197 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:40:00.818216 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:40:00.818216 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:40:00.818216 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:40:00.818216 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:40:00.818216 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:40:00.818216 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:40:00.818216 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:40:00.818216 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:40:00.818216 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:40:00.818216 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:40:00.818216 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:40:00.818216 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:40:00.818216 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:40:00.818216 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:40:00.818216 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:40:00.818216 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:40:00.818216 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:40:00.819106 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:40:00.819106 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:40:00.819106 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:40:00.819106 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:40:00.819106 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:40:00.819106 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:40:00.819106 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:40:00.819106 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:40:00.821752 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 370/731] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:40:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:40:00.827187 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107058d-1a8e-4bd5-9d4f-4795f2d1d86c None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:00.905784 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:00.929664 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08fdaf-eb11-42f7-8094-373eea45f33d None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:00.957675 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107058d-1a8e-4bd5-9d4f-4795f2d1d86c None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:01.000167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6917d-24b5-4109-9b7f-ec3dfdb24bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:01.000827 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6917d-24b5-4109-9b7f-ec3dfdb24bfb None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:01.001111 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6917d-24b5-4109-9b7f-ec3dfdb24bfb None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:01.001418 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6917d-24b5-4109-9b7f-ec3dfdb24bfb None admin] PATH_INFO: `/v3/projects` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:01.002145 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6917d-24b5-4109-9b7f-ec3dfdb24bfb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:01.002457 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6917d-24b5-4109-9b7f-ec3dfdb24bfb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:01.003943 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6917d-24b5-4109-9b7f-ec3dfdb24bfb None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:01.020806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 362/732] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 00:40:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:40:01.027729 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6917d-24b5-4109-9b7f-ec3dfdb24bfb None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:01.050579 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08fdaf-eb11-42f7-8094-373eea45f33d None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:01.086366 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0873d-9ced-4149-b56d-d6e0bcdc1dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:01.088056 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0873d-9ced-4149-b56d-d6e0bcdc1dd1 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:01.088428 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0873d-9ced-4149-b56d-d6e0bcdc1dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:01.088630 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0873d-9ced-4149-b56d-d6e0bcdc1dd1 None admin] PATH_INFO: `/v3/services/image` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:01.089226 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0873d-9ced-4149-b56d-d6e0bcdc1dd1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:01.090658 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0873d-9ced-4149-b56d-d6e0bcdc1dd1 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:01.099634 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-bea0873d-9ced-4149-b56d-d6e0bcdc1dd1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:40:01.099634 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:40:01.099634 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:40:01.099634 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:40:01.099634 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:40:01.099634 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:40:01.099634 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:40:01.099634 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:40:01.099634 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:40:01.099634 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:40:01.099634 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:40:01.099634 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:40:01.099634 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:40:01.099634 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:40:01.099634 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:40:01.099634 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:40:01.099634 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:40:01.100712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:40:01.100712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:40:01.100712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:40:01.100712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:40:01.100712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:40:01.100712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:40:01.100712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:40:01.100712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:40:01.100712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:40:01.100712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:40:01.100712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:40:01.100712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:40:01.100712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:40:01.100712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:40:01.100712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:40:01.100712 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:40:01.101662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:40:01.101662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:40:01.101662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:40:01.101662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:40:01.101662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:40:01.101662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:40:01.101662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:40:01.101662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:40:01.101662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:40:01.101662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:40:01.101662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:40:01.101662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:40:01.101662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:40:01.101662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:40:01.101662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 371/733] 10.222.0.20 () {56 vars in 1105 bytes} [Fri Aug 26 00:40:00 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:40:01.107559 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0873d-9ced-4149-b56d-d6e0bcdc1dd1 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:01.142334 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6917d-24b5-4109-9b7f-ec3dfdb24bfb None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:01.170606 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:01.172778 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:01.179114 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19103d70-dd9d-47d0-b3e1-adc186786c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:01.179757 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19103d70-dd9d-47d0-b3e1-adc186786c0b None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:01.180010 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19103d70-dd9d-47d0-b3e1-adc186786c0b None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:01.180316 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19103d70-dd9d-47d0-b3e1-adc186786c0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:01.181061 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19103d70-dd9d-47d0-b3e1-adc186786c0b None admin] RBAC: Adding query filter params (role.id=f13055bcebf847bf8b46160ded13810b, scope.project.id=fe7cc05cd9f44d74a635079ef883d9a9, user.id=02f74984033043ecabd28df33960a37c) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:01.181417 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19103d70-dd9d-47d0-b3e1-adc186786c0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:01.182849 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19103d70-dd9d-47d0-b3e1-adc186786c0b None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:01.188742 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 363/734] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 00:40:01 2022] GET /identity/v3/role_assignments?user.id=02f74984033043ecabd28df33960a37c&scope.project.id=fe7cc05cd9f44d74a635079ef883d9a9&role.id=f13055bcebf847bf8b46160ded13810b => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:40:01.190068 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35024128-3b12-42b4-a5c8-ff12b89a42a1 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:01.190360 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35024128-3b12-42b4-a5c8-ff12b89a42a1 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:01.190648 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35024128-3b12-42b4-a5c8-ff12b89a42a1 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:01.191848 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 364/735] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:40:01.198305 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7fc89-10b1-4cca-8f20-650d09b1de9e None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:01.198689 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7fc89-10b1-4cca-8f20-650d09b1de9e None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:01.198855 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7fc89-10b1-4cca-8f20-650d09b1de9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:01.218350 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-f3f7fc89-10b1-4cca-8f20-650d09b1de9e None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:01.228276 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-f3f7fc89-10b1-4cca-8f20-650d09b1de9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:01.230520 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0873d-9ced-4149-b56d-d6e0bcdc1dd1 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:01.284211 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3105a7f-fcd3-4e4e-a12f-03438f6a61ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:01.284830 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3105a7f-fcd3-4e4e-a12f-03438f6a61ce None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:01.285109 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3105a7f-fcd3-4e4e-a12f-03438f6a61ce None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:01.285420 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3105a7f-fcd3-4e4e-a12f-03438f6a61ce None admin] PATH_INFO: `/v3/services` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:01.286069 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3105a7f-fcd3-4e4e-a12f-03438f6a61ce None admin] RBAC: Adding query filter params (name=image) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:01.286377 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3105a7f-fcd3-4e4e-a12f-03438f6a61ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:01.287777 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3105a7f-fcd3-4e4e-a12f-03438f6a61ce None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:01.299728 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 372/736] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:40:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:40:01.301363 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3105a7f-fcd3-4e4e-a12f-03438f6a61ce None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:01.336067 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 365/737] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:40:01 2022] POST /identity/v3/auth/tokens => generated 1257 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:40:01.430421 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3105a7f-fcd3-4e4e-a12f-03438f6a61ce None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:01.459073 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:01.470608 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c59dc-260b-4376-aa6b-be1f1cba63fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:01.471198 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c59dc-260b-4376-aa6b-be1f1cba63fe None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:01.471491 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c59dc-260b-4376-aa6b-be1f1cba63fe None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:01.471743 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c59dc-260b-4376-aa6b-be1f1cba63fe None admin] PATH_INFO: `/v3/services` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:01.472452 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c59dc-260b-4376-aa6b-be1f1cba63fe None admin] RBAC: Adding query filter params (type=image) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:01.472758 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c59dc-260b-4376-aa6b-be1f1cba63fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:01.474271 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c59dc-260b-4376-aa6b-be1f1cba63fe None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:01.485995 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 373/738] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:40:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:40:01.487591 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7fc89-10b1-4cca-8f20-650d09b1de9e None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:01.606791 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7fc89-10b1-4cca-8f20-650d09b1de9e None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:01.636491 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:01.648088 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a7956-a0aa-4e8f-b284-9c3309ccb8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:01.648711 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a7956-a0aa-4e8f-b284-9c3309ccb8b0 None admin] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:01.648999 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a7956-a0aa-4e8f-b284-9c3309ccb8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:01.649357 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a7956-a0aa-4e8f-b284-9c3309ccb8b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:01.650009 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a7956-a0aa-4e8f-b284-9c3309ccb8b0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:01.651407 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a7956-a0aa-4e8f-b284-9c3309ccb8b0 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:01.678117 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c59dc-260b-4376-aa6b-be1f1cba63fe None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:01.738930 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 366/739] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 00:40:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:40:01.827065 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c59dc-260b-4376-aa6b-be1f1cba63fe None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:01.875670 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce32204-f6ed-4976-91b9-09efb03bfb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:01.876679 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce32204-f6ed-4976-91b9-09efb03bfb43 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:01.877109 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce32204-f6ed-4976-91b9-09efb03bfb43 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:01.877720 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce32204-f6ed-4976-91b9-09efb03bfb43 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:01.878481 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce32204-f6ed-4976-91b9-09efb03bfb43 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:01.880036 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce32204-f6ed-4976-91b9-09efb03bfb43 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:01.890893 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-dce32204-f6ed-4976-91b9-09efb03bfb43 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:40:01.890893 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:40:01.890893 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:40:01.890893 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:40:01.890893 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:40:01.890893 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:40:01.890893 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:40:01.890893 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:40:01.890893 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:40:01.890893 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:40:01.890893 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:40:01.890893 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:40:01.890893 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:40:01.890893 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:40:01.890893 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:40:01.890893 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:40:01.890893 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:40:01.892025 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:40:01.892025 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:40:01.892025 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:40:01.892025 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:40:01.892025 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:40:01.892025 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:40:01.892025 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:40:01.892025 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:40:01.892025 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:40:01.892025 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:40:01.892025 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:40:01.892025 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:40:01.892025 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:40:01.892025 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:40:01.892025 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:40:01.892025 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:40:01.893555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:40:01.893555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:40:01.893555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:40:01.893555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:40:01.893555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:40:01.893555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:40:01.893555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:40:01.893555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:40:01.893555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:40:01.893555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:40:01.893555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:40:01.893555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:40:01.893555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:40:01.893555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:40:01.893555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 374/740] 10.222.0.20 () {56 vars in 1129 bytes} [Fri Aug 26 00:40:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:40:01.899111 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a7956-a0aa-4e8f-b284-9c3309ccb8b0 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:02.026878 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a7956-a0aa-4e8f-b284-9c3309ccb8b0 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:02.070322 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c20904-7037-402c-a3f9-cbcba6b5077d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:02.071127 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c20904-7037-402c-a3f9-cbcba6b5077d None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:02.072171 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c20904-7037-402c-a3f9-cbcba6b5077d None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:02.072906 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c20904-7037-402c-a3f9-cbcba6b5077d None admin] PATH_INFO: `/v3/services` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:02.074268 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c20904-7037-402c-a3f9-cbcba6b5077d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:02.074760 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c20904-7037-402c-a3f9-cbcba6b5077d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:02.076608 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c20904-7037-402c-a3f9-cbcba6b5077d None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:02.083238 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 367/741] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Aug 26 00:40:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:40:02.089534 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce32204-f6ed-4976-91b9-09efb03bfb43 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:02.146143 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:02.200537 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce32204-f6ed-4976-91b9-09efb03bfb43 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:02.236332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57010840-71aa-4cd7-ae0a-0af4b1efdf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:02.236941 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57010840-71aa-4cd7-ae0a-0af4b1efdf2c None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:02.237230 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57010840-71aa-4cd7-ae0a-0af4b1efdf2c None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:02.237535 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57010840-71aa-4cd7-ae0a-0af4b1efdf2c None admin] PATH_INFO: `/v3/services` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:02.238174 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57010840-71aa-4cd7-ae0a-0af4b1efdf2c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:02.238477 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57010840-71aa-4cd7-ae0a-0af4b1efdf2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:02.239833 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57010840-71aa-4cd7-ae0a-0af4b1efdf2c None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:02.245497 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 375/742] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Aug 26 00:40:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:40:02.251615 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c20904-7037-402c-a3f9-cbcba6b5077d None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:02.302644 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:02.362287 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c20904-7037-402c-a3f9-cbcba6b5077d None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:02.399145 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21bbd43-f506-4de9-b178-c695531a6b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:02.400057 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bbd43-f506-4de9-b178-c695531a6b5d None admin] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:02.400344 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bbd43-f506-4de9-b178-c695531a6b5d None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:02.400625 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bbd43-f506-4de9-b178-c695531a6b5d None admin] PATH_INFO: `/v3/endpoints` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:02.401314 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21bbd43-f506-4de9-b178-c695531a6b5d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:02.402733 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21bbd43-f506-4de9-b178-c695531a6b5d None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:02.492861 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 368/743] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 00:40:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:40:03.548478 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576aeffd-8fde-4232-9056-3044abc19788 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:03.549039 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576aeffd-8fde-4232-9056-3044abc19788 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:03.549039 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576aeffd-8fde-4232-9056-3044abc19788 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:03.550646 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 376/744] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:40:03.557563 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5dded-3106-4c76-8b47-c8a74889f2f7 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:03.558058 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5dded-3106-4c76-8b47-c8a74889f2f7 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:03.558162 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5dded-3106-4c76-8b47-c8a74889f2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:03.578533 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-16f5dded-3106-4c76-8b47-c8a74889f2f7 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:03.579752 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-16f5dded-3106-4c76-8b47-c8a74889f2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:03.670390 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 369/745] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:40:03 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:40:04.007593 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576aeffd-8fde-4232-9056-3044abc19788 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:04.050031 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7a1d2-c519-487a-b27c-00b8445e1f53 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:04.050368 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7a1d2-c519-487a-b27c-00b8445e1f53 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:04.050563 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7a1d2-c519-487a-b27c-00b8445e1f53 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:04.051965 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 370/746] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:40:04.057296 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2b9aa-e262-4469-83d8-26349e7da662 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:04.057622 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2b9aa-e262-4469-83d8-26349e7da662 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:04.057926 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2b9aa-e262-4469-83d8-26349e7da662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:04.076513 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-54d2b9aa-e262-4469-83d8-26349e7da662 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:04.077771 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-54d2b9aa-e262-4469-83d8-26349e7da662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:04.100828 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:04.124109 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576aeffd-8fde-4232-9056-3044abc19788 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:04.138890 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:04.154698 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 371/747] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:40:04 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:40:04.164252 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef0914-9e17-4622-ae1b-a08751030e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:04.164931 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef0914-9e17-4622-ae1b-a08751030e13 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:04.165314 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef0914-9e17-4622-ae1b-a08751030e13 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:04.165849 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef0914-9e17-4622-ae1b-a08751030e13 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:04.166457 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef0914-9e17-4622-ae1b-a08751030e13 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:04.167830 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef0914-9e17-4622-ae1b-a08751030e13 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:04.176919 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-cfef0914-9e17-4622-ae1b-a08751030e13 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:40:04.176919 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:40:04.176919 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:40:04.176919 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:40:04.176919 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:40:04.176919 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:40:04.176919 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:40:04.176919 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:40:04.176919 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:40:04.176919 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:40:04.176919 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:40:04.176919 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:40:04.176919 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:40:04.176919 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:40:04.176919 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:40:04.176919 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:40:04.178100 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:40:04.178100 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:40:04.178100 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:40:04.178100 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:40:04.178100 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:40:04.178100 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:40:04.178100 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:40:04.178100 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:40:04.178100 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:40:04.178100 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:40:04.178100 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:40:04.178100 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:40:04.178100 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:40:04.178100 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:40:04.178100 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:40:04.178100 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:40:04.178100 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:40:04.178965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:40:04.178965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:40:04.178965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:40:04.178965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:40:04.178965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:40:04.178965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:40:04.178965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:40:04.178965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:40:04.178965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:40:04.178965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:40:04.178965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:40:04.178965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:40:04.178965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:40:04.178965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:40:04.181525 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 377/748] 10.222.0.20 () {56 vars in 1132 bytes} [Fri Aug 26 00:40:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:40:04.184212 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2b9aa-e262-4469-83d8-26349e7da662 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:04.292866 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2b9aa-e262-4469-83d8-26349e7da662 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:04.330393 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe4842-e553-4803-915c-0a33d7c9656b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:04.331011 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe4842-e553-4803-915c-0a33d7c9656b None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:04.331289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe4842-e553-4803-915c-0a33d7c9656b None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:04.331564 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe4842-e553-4803-915c-0a33d7c9656b None admin] PATH_INFO: `/v3/services` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:04.332198 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe4842-e553-4803-915c-0a33d7c9656b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:04.332501 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe4842-e553-4803-915c-0a33d7c9656b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:04.333909 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe4842-e553-4803-915c-0a33d7c9656b None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:04.346898 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 372/749] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Aug 26 00:40:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:40:04.347095 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef0914-9e17-4622-ae1b-a08751030e13 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:04.473340 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef0914-9e17-4622-ae1b-a08751030e13 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:04.490520 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe4842-e553-4803-915c-0a33d7c9656b None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:04.518394 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:04.524962 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58bbf3-8ff8-47b5-8eca-1487c374b52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:04.525607 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58bbf3-8ff8-47b5-8eca-1487c374b52d None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:04.525879 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58bbf3-8ff8-47b5-8eca-1487c374b52d None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:04.526170 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58bbf3-8ff8-47b5-8eca-1487c374b52d None admin] PATH_INFO: `/v3/services` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:04.526783 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58bbf3-8ff8-47b5-8eca-1487c374b52d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:04.527086 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58bbf3-8ff8-47b5-8eca-1487c374b52d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:04.528571 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58bbf3-8ff8-47b5-8eca-1487c374b52d None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:04.537907 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 378/750] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Aug 26 00:40:04 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:40:04.636145 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe4842-e553-4803-915c-0a33d7c9656b None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:04.676758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6d271-741e-49b5-af3f-f69f614c9639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:04.677410 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6d271-741e-49b5-af3f-f69f614c9639 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:04.677708 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6d271-741e-49b5-af3f-f69f614c9639 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:04.678074 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6d271-741e-49b5-af3f-f69f614c9639 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:04.750372 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d2c19-fe10-461d-9161-83bbfc58e2cc None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:04.751104 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d2c19-fe10-461d-9161-83bbfc58e2cc None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:04.751284 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d2c19-fe10-461d-9161-83bbfc58e2cc None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:04.752856 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 379/751] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:40:04.758429 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655582c-263a-4407-bf9a-42d2db0dd1ce None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:04.759490 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655582c-263a-4407-bf9a-42d2db0dd1ce None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:04.760086 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655582c-263a-4407-bf9a-42d2db0dd1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:04.768762 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6d271-741e-49b5-af3f-f69f614c9639 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:04.770438 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6d271-741e-49b5-af3f-f69f614c9639 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:04.780613 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-5655582c-263a-4407-bf9a-42d2db0dd1ce None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:04.782280 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-5655582c-263a-4407-bf9a-42d2db0dd1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:04.794123 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:04.827813 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:04.867533 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 380/752] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:40:04 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:40:04.884797 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 373/753] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:40:04 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 00:40:04.890821 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655582c-263a-4407-bf9a-42d2db0dd1ce None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:05.007997 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655582c-263a-4407-bf9a-42d2db0dd1ce None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:05.043975 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3010a-e7ed-4161-9c13-401363e3831a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:05.044642 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3010a-e7ed-4161-9c13-401363e3831a None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:05.044918 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3010a-e7ed-4161-9c13-401363e3831a None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:05.045189 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3010a-e7ed-4161-9c13-401363e3831a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:05.059393 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3010a-e7ed-4161-9c13-401363e3831a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:05.060855 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3010a-e7ed-4161-9c13-401363e3831a None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:05.077103 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-92c3010a-e7ed-4161-9c13-401363e3831a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:40:05.077103 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:40:05.077103 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:40:05.077103 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:40:05.077103 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:40:05.077103 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:40:05.077103 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:40:05.077103 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:40:05.077103 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:40:05.077103 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:40:05.077103 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:40:05.077103 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:40:05.077103 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:40:05.077103 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:40:05.077103 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:40:05.077103 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:40:05.083304 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:40:05.083304 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:40:05.083304 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:40:05.083304 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:40:05.083304 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:40:05.083304 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:40:05.083304 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:40:05.083304 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:40:05.083304 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:40:05.083304 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:40:05.083304 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:40:05.083304 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:40:05.083304 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:40:05.083304 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:40:05.083304 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:40:05.083304 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:40:05.083304 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:40:05.084301 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:40:05.084301 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:40:05.084301 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:40:05.084301 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 381/754] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:40:05.086302 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6d271-741e-49b5-af3f-f69f614c9639 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:05.197822 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6d271-741e-49b5-af3f-f69f614c9639 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:05.207026 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3010a-e7ed-4161-9c13-401363e3831a None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:05.219677 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:05.235389 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:05.235651 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f8b8c-cb19-4b23-8b65-1e8b9fe2faed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:05.236278 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f8b8c-cb19-4b23-8b65-1e8b9fe2faed None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:05.236563 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f8b8c-cb19-4b23-8b65-1e8b9fe2faed None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:05.236841 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f8b8c-cb19-4b23-8b65-1e8b9fe2faed None admin] PATH_INFO: `/v3/domains` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:05.237529 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f8b8c-cb19-4b23-8b65-1e8b9fe2faed None admin] RBAC: Adding query filter params (name=Default) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:05.237841 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f8b8c-cb19-4b23-8b65-1e8b9fe2faed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:05.239314 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f8b8c-cb19-4b23-8b65-1e8b9fe2faed None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:05.252119 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 374/755] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:40:05.331614 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3010a-e7ed-4161-9c13-401363e3831a None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:05.373452 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e8dc0-e39f-41dc-b2cc-4f62a7158874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:05.374134 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e8dc0-e39f-41dc-b2cc-4f62a7158874 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:05.374481 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e8dc0-e39f-41dc-b2cc-4f62a7158874 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:05.374819 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e8dc0-e39f-41dc-b2cc-4f62a7158874 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:05.375417 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e8dc0-e39f-41dc-b2cc-4f62a7158874 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:05.376819 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e8dc0-e39f-41dc-b2cc-4f62a7158874 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:05.386861 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-516e8dc0-e39f-41dc-b2cc-4f62a7158874 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:40:05.386861 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:40:05.386861 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:40:05.386861 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:40:05.386861 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:40:05.386861 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:40:05.386861 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:40:05.386861 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:40:05.386861 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:40:05.386861 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:40:05.386861 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:40:05.386861 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:40:05.386861 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:40:05.386861 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:40:05.386861 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:40:05.386861 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:40:05.386861 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:40:05.387945 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:40:05.387945 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:40:05.387945 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:40:05.387945 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:40:05.387945 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:40:05.387945 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:40:05.387945 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:40:05.387945 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:40:05.387945 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:40:05.387945 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:40:05.387945 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:40:05.387945 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:40:05.387945 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:40:05.387945 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:40:05.387945 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:40:05.387945 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:40:05.388776 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:40:05.388776 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:40:05.388776 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:40:05.388776 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:40:05.388776 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:40:05.388776 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:40:05.388776 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:40:05.388776 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:40:05.388776 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:40:05.388776 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:40:05.388776 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:40:05.388776 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:40:05.388776 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:40:05.388776 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:40:05.393429 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 382/756] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 00:40:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:40:05.394481 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f8b8c-cb19-4b23-8b65-1e8b9fe2faed None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:05.512142 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f8b8c-cb19-4b23-8b65-1e8b9fe2faed None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:05.552810 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecfe08-b479-4131-bff0-7f6b4527f772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:05.553472 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecfe08-b479-4131-bff0-7f6b4527f772 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:05.553758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecfe08-b479-4131-bff0-7f6b4527f772 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:05.554035 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecfe08-b479-4131-bff0-7f6b4527f772 None admin] PATH_INFO: `/v3/services` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:05.554817 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ecfe08-b479-4131-bff0-7f6b4527f772 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:05.555124 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ecfe08-b479-4131-bff0-7f6b4527f772 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:05.557058 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ecfe08-b479-4131-bff0-7f6b4527f772 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:05.565021 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 375/757] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 00:40:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:40:05.571931 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e8dc0-e39f-41dc-b2cc-4f62a7158874 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:05.683959 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:05.701989 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e8dc0-e39f-41dc-b2cc-4f62a7158874 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:05.739937 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223972bb-e727-4232-9a0d-2915674e3667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:05.740557 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223972bb-e727-4232-9a0d-2915674e3667 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:05.740838 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223972bb-e727-4232-9a0d-2915674e3667 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:05.741111 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223972bb-e727-4232-9a0d-2915674e3667 None admin] PATH_INFO: `/v3/services` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:05.741882 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223972bb-e727-4232-9a0d-2915674e3667 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:05.742187 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223972bb-e727-4232-9a0d-2915674e3667 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:05.743740 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223972bb-e727-4232-9a0d-2915674e3667 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:05.749390 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 383/758] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 00:40:05 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:40:06.795824 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583e424-143c-48b5-b4ea-aa53ca932059 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:06.796468 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583e424-143c-48b5-b4ea-aa53ca932059 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:06.796609 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583e424-143c-48b5-b4ea-aa53ca932059 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:06.798625 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 376/759] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:40:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:40:06.808054 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d6585-5c47-45b0-b006-060d15f92897 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:06.808618 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d6585-5c47-45b0-b006-060d15f92897 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:06.809122 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d6585-5c47-45b0-b006-060d15f92897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:06.840549 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-6f2d6585-5c47-45b0-b006-060d15f92897 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:06.842745 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-6f2d6585-5c47-45b0-b006-060d15f92897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:06.921561 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 384/760] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:40:06 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:40:07.253987 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583e424-143c-48b5-b4ea-aa53ca932059 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:07.305419 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:07.364040 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583e424-143c-48b5-b4ea-aa53ca932059 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:07.398828 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4c8e2-f986-40da-b5f4-042a4d4931e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:07.400014 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4c8e2-f986-40da-b5f4-042a4d4931e1 None admin] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:07.400291 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4c8e2-f986-40da-b5f4-042a4d4931e1 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:07.400563 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4c8e2-f986-40da-b5f4-042a4d4931e1 None admin] PATH_INFO: `/v3/services` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:07.401219 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d4c8e2-f986-40da-b5f4-042a4d4931e1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:07.402628 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d4c8e2-f986-40da-b5f4-042a4d4931e1 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:07.498739 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 377/761] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 26 00:40:07 2022] POST /identity/v3/services => generated 269 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:40:07.984767 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516a67e-485a-40ba-a230-a527774056b0 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:07.985293 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516a67e-485a-40ba-a230-a527774056b0 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:07.985293 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516a67e-485a-40ba-a230-a527774056b0 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:07.986802 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 385/762] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:40:07.991985 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc840f-3346-4b1c-87dc-afdbf36a83e9 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:07.992418 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc840f-3346-4b1c-87dc-afdbf36a83e9 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:07.992617 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc840f-3346-4b1c-87dc-afdbf36a83e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:08.011645 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-c1dc840f-3346-4b1c-87dc-afdbf36a83e9 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:08.012861 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-c1dc840f-3346-4b1c-87dc-afdbf36a83e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:08.087302 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 378/763] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:40:07 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:40:08.418289 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516a67e-485a-40ba-a230-a527774056b0 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:08.506537 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:08.528280 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516a67e-485a-40ba-a230-a527774056b0 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:08.563841 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1795d9e-a1a5-4b61-9d7e-86999a60b700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:08.564459 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1795d9e-a1a5-4b61-9d7e-86999a60b700 None admin] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:08.565011 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1795d9e-a1a5-4b61-9d7e-86999a60b700 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:08.565011 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1795d9e-a1a5-4b61-9d7e-86999a60b700 None admin] PATH_INFO: `/v3/services` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:08.565641 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1795d9e-a1a5-4b61-9d7e-86999a60b700 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:08.567046 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1795d9e-a1a5-4b61-9d7e-86999a60b700 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:08.657902 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 386/764] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 26 00:40:08 2022] POST /identity/v3/services => generated 251 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:40:09.820574 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde7c7e-0fe0-4ab6-84cc-3e653dd2f797 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:09.821283 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde7c7e-0fe0-4ab6-84cc-3e653dd2f797 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:09.821283 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde7c7e-0fe0-4ab6-84cc-3e653dd2f797 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:09.823786 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 379/765] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:40:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:40:09.829698 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9f07f-903c-47a8-843c-536842de6b8a None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:09.830207 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9f07f-903c-47a8-843c-536842de6b8a None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:09.830297 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9f07f-903c-47a8-843c-536842de6b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:09.850522 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-ebf9f07f-903c-47a8-843c-536842de6b8a None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:09.851765 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-ebf9f07f-903c-47a8-843c-536842de6b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:09.953617 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 387/766] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:40:09 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:40:10.338898 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde7c7e-0fe0-4ab6-84cc-3e653dd2f797 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:10.372981 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:10.485357 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde7c7e-0fe0-4ab6-84cc-3e653dd2f797 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:10.529326 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70857f07-376e-4576-bd91-838e3483306a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:10.530060 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70857f07-376e-4576-bd91-838e3483306a None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:10.530344 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70857f07-376e-4576-bd91-838e3483306a None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:10.530624 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70857f07-376e-4576-bd91-838e3483306a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:10.531226 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70857f07-376e-4576-bd91-838e3483306a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:10.532612 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70857f07-376e-4576-bd91-838e3483306a None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:10.542048 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-70857f07-376e-4576-bd91-838e3483306a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:40:10.542048 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:40:10.542048 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:40:10.542048 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:40:10.542048 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:40:10.542048 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:40:10.542048 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:40:10.542048 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:40:10.542048 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:40:10.542048 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:40:10.542048 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:40:10.542048 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:40:10.542048 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:40:10.542048 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:40:10.542048 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:40:10.542048 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:40:10.543205 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:40:10.543205 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:40:10.543205 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:40:10.543205 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:40:10.543205 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:40:10.543205 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:40:10.543205 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:40:10.543205 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:40:10.543205 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:40:10.543205 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:40:10.543205 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:40:10.543205 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:40:10.543205 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:40:10.543205 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:40:10.543205 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:40:10.543205 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:40:10.543205 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:40:10.544631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:40:10.544631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:40:10.544631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:40:10.544631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:40:10.544631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:40:10.544631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:40:10.544631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:40:10.544631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:40:10.544631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:40:10.544631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:40:10.544631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:40:10.544631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:40:10.544631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:40:10.544631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:40:10.544631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 380/767] 10.222.0.20 () {56 vars in 1132 bytes} [Fri Aug 26 00:40:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:40:10.549666 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf9f07f-903c-47a8-843c-536842de6b8a None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:10.619669 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:10.656674 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf9f07f-903c-47a8-843c-536842de6b8a None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:10.700708 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a5ec2-8753-4727-a25d-b75f59ae06cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:10.701323 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a5ec2-8753-4727-a25d-b75f59ae06cc None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:10.701632 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a5ec2-8753-4727-a25d-b75f59ae06cc None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:10.701902 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a5ec2-8753-4727-a25d-b75f59ae06cc None admin] PATH_INFO: `/v3/services` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:10.702546 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a5ec2-8753-4727-a25d-b75f59ae06cc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:10.702848 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a5ec2-8753-4727-a25d-b75f59ae06cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:10.704228 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a5ec2-8753-4727-a25d-b75f59ae06cc None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:10.709390 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 388/768] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Aug 26 00:40:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:40:10.715274 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70857f07-376e-4576-bd91-838e3483306a None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:10.816500 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:10.824767 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70857f07-376e-4576-bd91-838e3483306a None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:10.860612 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db397ef-f883-4dd8-8385-6c5767dec562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:10.861245 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db397ef-f883-4dd8-8385-6c5767dec562 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:10.861646 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db397ef-f883-4dd8-8385-6c5767dec562 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:10.861937 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db397ef-f883-4dd8-8385-6c5767dec562 None admin] PATH_INFO: `/v3/services` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:10.862884 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db397ef-f883-4dd8-8385-6c5767dec562 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:10.863375 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db397ef-f883-4dd8-8385-6c5767dec562 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:10.865112 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db397ef-f883-4dd8-8385-6c5767dec562 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:10.872559 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 381/769] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Aug 26 00:40:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:40:10.878810 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a5ec2-8753-4727-a25d-b75f59ae06cc None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:10.996915 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a5ec2-8753-4727-a25d-b75f59ae06cc None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:11.027668 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:11.033626 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae86622-baeb-4f40-a9b1-530f38541285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:11.034246 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae86622-baeb-4f40-a9b1-530f38541285 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:11.034531 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae86622-baeb-4f40-a9b1-530f38541285 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:11.034802 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae86622-baeb-4f40-a9b1-530f38541285 None admin] PATH_INFO: `/v3/endpoints` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:11.035514 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae86622-baeb-4f40-a9b1-530f38541285 None admin] RBAC: Adding query filter params (interface=public, service_id=273b2a790b3e4eb49bde62a9c3a5592b, region_id=RegionOne) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:11.035825 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae86622-baeb-4f40-a9b1-530f38541285 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:11.037209 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae86622-baeb-4f40-a9b1-530f38541285 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:11.046204 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 389/770] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Aug 26 00:40:10 2022] GET /identity/v3/endpoints?service_id=273b2a790b3e4eb49bde62a9c3a5592b&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:40:11.052106 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db397ef-f883-4dd8-8385-6c5767dec562 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:11.069226 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2fa83-6e80-4bf0-8908-db22e2fe2075 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:11.069226 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2fa83-6e80-4bf0-8908-db22e2fe2075 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:11.069226 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2fa83-6e80-4bf0-8908-db22e2fe2075 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:11.069226 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 390/771] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:40:11.070071 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae4c77-984e-4b04-9f4b-c1a7237a40c3 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:11.070360 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae4c77-984e-4b04-9f4b-c1a7237a40c3 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:11.070638 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae4c77-984e-4b04-9f4b-c1a7237a40c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:11.088823 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-44ae4c77-984e-4b04-9f4b-c1a7237a40c3 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:11.090093 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-44ae4c77-984e-4b04-9f4b-c1a7237a40c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:11.169023 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 391/772] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:40:11 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:40:11.284706 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db397ef-f883-4dd8-8385-6c5767dec562 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:11.324615 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207070f-9dfe-4c66-a501-6f703c736286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:11.325251 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207070f-9dfe-4c66-a501-6f703c736286 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:11.325557 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207070f-9dfe-4c66-a501-6f703c736286 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:11.325832 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207070f-9dfe-4c66-a501-6f703c736286 None admin] PATH_INFO: `/v3/services` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:11.326448 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207070f-9dfe-4c66-a501-6f703c736286 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:11.327861 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207070f-9dfe-4c66-a501-6f703c736286 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:11.334538 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 382/773] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Aug 26 00:40:11 2022] GET /identity/v3/services => generated 1498 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:40:11.514634 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae4c77-984e-4b04-9f4b-c1a7237a40c3 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:11.624900 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae4c77-984e-4b04-9f4b-c1a7237a40c3 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:11.652911 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:11.664982 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3553ada-c455-4fc5-8e22-9d4b676b4009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:11.665505 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3553ada-c455-4fc5-8e22-9d4b676b4009 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:11.665793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3553ada-c455-4fc5-8e22-9d4b676b4009 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:11.666068 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3553ada-c455-4fc5-8e22-9d4b676b4009 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:11.666662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3553ada-c455-4fc5-8e22-9d4b676b4009 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:11.668101 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3553ada-c455-4fc5-8e22-9d4b676b4009 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:11.680823 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-d3553ada-c455-4fc5-8e22-9d4b676b4009 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:40:11.680823 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:40:11.680823 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:40:11.680823 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:40:11.680823 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:40:11.680823 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:40:11.680823 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:40:11.680823 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:40:11.680823 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:40:11.680823 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:40:11.680823 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:40:11.680823 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:40:11.680823 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:40:11.680823 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:40:11.680823 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:40:11.680823 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:40:11.680823 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:40:11.681905 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:40:11.681905 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:40:11.681905 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:40:11.681905 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:40:11.681905 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:40:11.681905 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:40:11.681905 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:40:11.681905 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:40:11.681905 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:40:11.681905 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:40:11.681905 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:40:11.681905 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:40:11.681905 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:40:11.681905 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:40:11.681905 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:40:11.681905 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:40:11.683005 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:40:11.683005 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:40:11.683005 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:40:11.683005 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:40:11.683005 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:40:11.683005 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:40:11.683005 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:40:11.683005 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:40:11.683005 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:40:11.683005 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:40:11.683005 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:40:11.683005 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:40:11.683005 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:40:11.683005 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:40:11.683005 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 392/774] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 00:40:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:40:11.688131 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207070f-9dfe-4c66-a501-6f703c736286 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:11.716210 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:11.807162 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207070f-9dfe-4c66-a501-6f703c736286 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:11.843791 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4c7c8-b894-420a-8718-3b03a23ab765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:11.844472 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4c7c8-b894-420a-8718-3b03a23ab765 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:11.844679 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4c7c8-b894-420a-8718-3b03a23ab765 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:11.844956 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4c7c8-b894-420a-8718-3b03a23ab765 None admin] PATH_INFO: `/v3/services` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:11.845637 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4c7c8-b894-420a-8718-3b03a23ab765 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:11.845947 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4c7c8-b894-420a-8718-3b03a23ab765 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:11.847331 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4c7c8-b894-420a-8718-3b03a23ab765 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:11.852430 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 383/775] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 00:40:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:40:11.858503 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3553ada-c455-4fc5-8e22-9d4b676b4009 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:11.967950 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3553ada-c455-4fc5-8e22-9d4b676b4009 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:12.002168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb92be-8d16-4c9f-be2f-de9ba8b84b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:12.002772 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb92be-8d16-4c9f-be2f-de9ba8b84b95 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:12.003052 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb92be-8d16-4c9f-be2f-de9ba8b84b95 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:12.003324 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb92be-8d16-4c9f-be2f-de9ba8b84b95 None admin] PATH_INFO: `/v3/services` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:12.003953 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb92be-8d16-4c9f-be2f-de9ba8b84b95 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:12.004281 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb92be-8d16-4c9f-be2f-de9ba8b84b95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:12.005695 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb92be-8d16-4c9f-be2f-de9ba8b84b95 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:12.016249 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 393/776] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 00:40:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:40:12.018093 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4c7c8-b894-420a-8718-3b03a23ab765 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:12.109499 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:12.124974 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4c7c8-b894-420a-8718-3b03a23ab765 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:12.162006 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028643f-b246-4de1-9e47-e8990023b924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:12.162619 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028643f-b246-4de1-9e47-e8990023b924 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:12.162924 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028643f-b246-4de1-9e47-e8990023b924 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:12.163203 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028643f-b246-4de1-9e47-e8990023b924 None admin] PATH_INFO: `/v3/endpoints` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:12.163908 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9028643f-b246-4de1-9e47-e8990023b924 None admin] RBAC: Adding query filter params (interface=public, service_id=0ffb50d7bcde456db812e63476068277, region_id=RegionOne) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:12.164248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9028643f-b246-4de1-9e47-e8990023b924 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:12.165755 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9028643f-b246-4de1-9e47-e8990023b924 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:12.171226 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 384/777] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Aug 26 00:40:12 2022] GET /identity/v3/endpoints?service_id=0ffb50d7bcde456db812e63476068277&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:40:12.177166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb92be-8d16-4c9f-be2f-de9ba8b84b95 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:12.233816 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:12.284468 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb92be-8d16-4c9f-be2f-de9ba8b84b95 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:12.319039 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a363d-37ea-4ff7-a63b-f3d6c3ef465a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:12.319640 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a363d-37ea-4ff7-a63b-f3d6c3ef465a None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:12.319925 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a363d-37ea-4ff7-a63b-f3d6c3ef465a None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:12.320196 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a363d-37ea-4ff7-a63b-f3d6c3ef465a None admin] PATH_INFO: `/v3/services` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:12.320800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a363d-37ea-4ff7-a63b-f3d6c3ef465a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:12.322779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a363d-37ea-4ff7-a63b-f3d6c3ef465a None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:12.328909 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 394/778] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Aug 26 00:40:12 2022] GET /identity/v3/services => generated 1498 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:40:13.608973 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73730d6-6bc7-4ada-90bc-12632bf8f3db None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:13.609701 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73730d6-6bc7-4ada-90bc-12632bf8f3db None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:13.609701 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73730d6-6bc7-4ada-90bc-12632bf8f3db None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:13.610885 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 385/779] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:40:13.616030 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6ed0d-4b24-4a31-92c8-8a5886110af2 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:13.616436 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6ed0d-4b24-4a31-92c8-8a5886110af2 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:13.616601 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6ed0d-4b24-4a31-92c8-8a5886110af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:13.635862 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-74d6ed0d-4b24-4a31-92c8-8a5886110af2 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:13.637064 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-74d6ed0d-4b24-4a31-92c8-8a5886110af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:13.704725 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 395/780] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:40:13 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:40:14.037005 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73730d6-6bc7-4ada-90bc-12632bf8f3db None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:14.140379 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73730d6-6bc7-4ada-90bc-12632bf8f3db None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:14.177287 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09581a-1b3f-4c27-bc76-d803177e50fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:14.177944 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09581a-1b3f-4c27-bc76-d803177e50fe None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:14.178229 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09581a-1b3f-4c27-bc76-d803177e50fe None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:14.178509 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09581a-1b3f-4c27-bc76-d803177e50fe None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:14.179094 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09581a-1b3f-4c27-bc76-d803177e50fe None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:14.181051 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09581a-1b3f-4c27-bc76-d803177e50fe None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:14.189836 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-5c09581a-1b3f-4c27-bc76-d803177e50fe None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:40:14.189836 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:40:14.189836 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:40:14.189836 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:40:14.189836 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:40:14.189836 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:40:14.189836 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:40:14.189836 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:40:14.189836 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:40:14.189836 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:40:14.189836 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:40:14.189836 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:40:14.189836 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:40:14.189836 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:40:14.189836 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:40:14.189836 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:40:14.193580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:40:14.193580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:40:14.193580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:40:14.193580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:40:14.193580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:40:14.193580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:40:14.193580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:40:14.193580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:40:14.193580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:40:14.193580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:40:14.193580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:40:14.193580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:40:14.193580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:40:14.193580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:40:14.193580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:40:14.193580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:40:14.193580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:40:14.194728 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:40:14.194728 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:40:14.194728 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:40:14.194728 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:40:14.194728 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:40:14.194728 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:40:14.194728 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:40:14.194728 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:40:14.194728 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:40:14.194728 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:40:14.194728 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:40:14.194728 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:40:14.194728 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:40:14.194728 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:40:14.194728 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 386/781] 10.222.0.20 () {56 vars in 1132 bytes} [Fri Aug 26 00:40:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:40:14.197320 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6ed0d-4b24-4a31-92c8-8a5886110af2 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:14.243813 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:14.303018 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6ed0d-4b24-4a31-92c8-8a5886110af2 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:14.338207 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207c2ef-d0d8-4f7e-8956-694b70c7d786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:14.338822 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207c2ef-d0d8-4f7e-8956-694b70c7d786 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:14.339135 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207c2ef-d0d8-4f7e-8956-694b70c7d786 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:14.339369 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207c2ef-d0d8-4f7e-8956-694b70c7d786 None admin] PATH_INFO: `/v3/services` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:14.340007 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207c2ef-d0d8-4f7e-8956-694b70c7d786 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:14.340318 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207c2ef-d0d8-4f7e-8956-694b70c7d786 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:14.341741 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207c2ef-d0d8-4f7e-8956-694b70c7d786 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:14.346917 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 396/782] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Aug 26 00:40:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:40:14.352693 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09581a-1b3f-4c27-bc76-d803177e50fe None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:14.369745 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:14.467937 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09581a-1b3f-4c27-bc76-d803177e50fe None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:14.502921 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b8139-fd90-4058-9cb1-9d0c8d9628b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:14.503531 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b8139-fd90-4058-9cb1-9d0c8d9628b2 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:14.503815 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b8139-fd90-4058-9cb1-9d0c8d9628b2 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:14.504090 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b8139-fd90-4058-9cb1-9d0c8d9628b2 None admin] PATH_INFO: `/v3/services` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:14.504723 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b8139-fd90-4058-9cb1-9d0c8d9628b2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:14.505033 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b8139-fd90-4058-9cb1-9d0c8d9628b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:14.506472 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b8139-fd90-4058-9cb1-9d0c8d9628b2 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:14.512056 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 387/783] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Aug 26 00:40:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:40:14.517945 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207c2ef-d0d8-4f7e-8956-694b70c7d786 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:14.566675 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ead19f-f2cc-48d6-bf2d-9ded4506a635 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:14.566959 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ead19f-f2cc-48d6-bf2d-9ded4506a635 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:14.567235 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ead19f-f2cc-48d6-bf2d-9ded4506a635 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:14.568569 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 388/784] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:40:14.574366 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a78407-01bf-4963-baba-f5989cca7ef1 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:14.574657 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a78407-01bf-4963-baba-f5989cca7ef1 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:14.574942 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a78407-01bf-4963-baba-f5989cca7ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:14.593167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-b7a78407-01bf-4963-baba-f5989cca7ef1 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:14.594401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-b7a78407-01bf-4963-baba-f5989cca7ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:14.621170 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207c2ef-d0d8-4f7e-8956-694b70c7d786 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:14.632166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:14.657799 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e3cd2-10fa-4361-8043-f54cae5b8fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:14.658402 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e3cd2-10fa-4361-8043-f54cae5b8fc7 None admin] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:14.658685 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e3cd2-10fa-4361-8043-f54cae5b8fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:14.659203 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e3cd2-10fa-4361-8043-f54cae5b8fc7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:14.659636 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e3cd2-10fa-4361-8043-f54cae5b8fc7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:14.661078 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e3cd2-10fa-4361-8043-f54cae5b8fc7 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:14.663495 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 389/785] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:40:14 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:40:14.761090 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 397/786] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 00:40:14 2022] POST /identity/v3/endpoints => generated 347 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:40:14.995872 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a78407-01bf-4963-baba-f5989cca7ef1 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:15.007397 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:15.104670 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a78407-01bf-4963-baba-f5989cca7ef1 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:15.148090 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b177b73-b7a4-4b07-b4ff-3d65cb6d7bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:15.148721 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b177b73-b7a4-4b07-b4ff-3d65cb6d7bf7 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:15.164115 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b177b73-b7a4-4b07-b4ff-3d65cb6d7bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:15.164115 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b177b73-b7a4-4b07-b4ff-3d65cb6d7bf7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:15.164115 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b177b73-b7a4-4b07-b4ff-3d65cb6d7bf7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:15.164115 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b177b73-b7a4-4b07-b4ff-3d65cb6d7bf7 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:15.164115 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-3b177b73-b7a4-4b07-b4ff-3d65cb6d7bf7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:40:15.164115 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:40:15.164115 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:40:15.164115 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:40:15.164115 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:40:15.165604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:40:15.165604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:40:15.165604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:40:15.165604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:40:15.165604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:40:15.165604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:40:15.165604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:40:15.165604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:40:15.165604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:40:15.165604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:40:15.165604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:40:15.165604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:40:15.165604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:40:15.165604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:40:15.165604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:40:15.165604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:40:15.165604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:40:15.166793 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:40:15.166793 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:40:15.166793 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:40:15.166793 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:40:15.166793 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:40:15.166793 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:40:15.166793 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:40:15.166793 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:40:15.166793 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:40:15.166793 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:40:15.166793 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:40:15.166793 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:40:15.166793 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:40:15.166793 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:40:15.166793 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:40:15.166793 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:40:15.166793 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:40:15.167648 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:40:15.167648 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:40:15.167648 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:40:15.167648 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:40:15.167648 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:40:15.167648 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:40:15.167648 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:40:15.167648 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:40:15.167648 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 390/787] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 00:40:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:40:15.169436 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e3cd2-10fa-4361-8043-f54cae5b8fc7 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:15.273036 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e3cd2-10fa-4361-8043-f54cae5b8fc7 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:15.308791 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30686e0-c1ea-4c42-a46e-501facfcf64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:15.309425 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30686e0-c1ea-4c42-a46e-501facfcf64e None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:15.309728 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30686e0-c1ea-4c42-a46e-501facfcf64e None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:15.309992 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30686e0-c1ea-4c42-a46e-501facfcf64e None admin] PATH_INFO: `/v3/services` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:15.313364 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30686e0-c1ea-4c42-a46e-501facfcf64e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:15.313364 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30686e0-c1ea-4c42-a46e-501facfcf64e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:15.313364 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30686e0-c1ea-4c42-a46e-501facfcf64e None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:15.317037 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 398/788] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 00:40:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:40:15.322886 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b177b73-b7a4-4b07-b4ff-3d65cb6d7bf7 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:15.393170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:15.426587 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b177b73-b7a4-4b07-b4ff-3d65cb6d7bf7 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:15.462523 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c172f6-7869-4f1b-b9ea-16b18aa4725c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:15.463297 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c172f6-7869-4f1b-b9ea-16b18aa4725c None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:15.463579 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c172f6-7869-4f1b-b9ea-16b18aa4725c None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:15.463854 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c172f6-7869-4f1b-b9ea-16b18aa4725c None admin] PATH_INFO: `/v3/services` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:15.464485 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c172f6-7869-4f1b-b9ea-16b18aa4725c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:15.464790 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c172f6-7869-4f1b-b9ea-16b18aa4725c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:15.466180 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c172f6-7869-4f1b-b9ea-16b18aa4725c None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:15.471419 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 391/789] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 26 00:40:15 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:40:15.476972 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30686e0-c1ea-4c42-a46e-501facfcf64e None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:15.507674 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:15.580735 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30686e0-c1ea-4c42-a46e-501facfcf64e None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:15.614503 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06b433-2303-4775-8caf-3618eda38c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:15.615097 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06b433-2303-4775-8caf-3618eda38c76 None admin] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:15.615374 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06b433-2303-4775-8caf-3618eda38c76 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:15.615645 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06b433-2303-4775-8caf-3618eda38c76 None admin] PATH_INFO: `/v3/endpoints` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:15.616295 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd06b433-2303-4775-8caf-3618eda38c76 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:15.617734 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd06b433-2303-4775-8caf-3618eda38c76 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:15.769420 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 399/790] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 00:40:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:40:17.035967 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e62fb-2a53-4cde-a14d-1839546fa94d None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:17.036489 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e62fb-2a53-4cde-a14d-1839546fa94d None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:17.036578 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e62fb-2a53-4cde-a14d-1839546fa94d None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:17.038009 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 392/791] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:40:17.043849 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7a41c-e3bd-47b6-b3dc-b4cb795acf5f None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:17.044284 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7a41c-e3bd-47b6-b3dc-b4cb795acf5f None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:17.044565 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7a41c-e3bd-47b6-b3dc-b4cb795acf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:17.063825 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-e5a7a41c-e3bd-47b6-b3dc-b4cb795acf5f None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:17.065048 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-e5a7a41c-e3bd-47b6-b3dc-b4cb795acf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:17.138930 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 400/792] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:40:17 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:40:17.475840 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e62fb-2a53-4cde-a14d-1839546fa94d None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:17.581525 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e62fb-2a53-4cde-a14d-1839546fa94d None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:17.611465 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:17.616737 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8f2e0-f8e9-49c2-889a-fff1f8fb8488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:17.617399 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8f2e0-f8e9-49c2-889a-fff1f8fb8488 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:17.618225 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8f2e0-f8e9-49c2-889a-fff1f8fb8488 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:17.618590 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8f2e0-f8e9-49c2-889a-fff1f8fb8488 None admin] PATH_INFO: `/v3/services/compute` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:17.619111 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8f2e0-f8e9-49c2-889a-fff1f8fb8488 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:17.620492 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8f2e0-f8e9-49c2-889a-fff1f8fb8488 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:17.629247 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-f4f8f2e0-f8e9-49c2-889a-fff1f8fb8488 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:40:17.629247 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:40:17.629247 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:40:17.629247 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:40:17.629247 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:40:17.629247 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:40:17.629247 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:40:17.629247 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:40:17.629247 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:40:17.629247 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:40:17.629247 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:40:17.629247 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:40:17.629247 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:40:17.629247 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:40:17.629247 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:40:17.629247 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:40:17.629247 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:40:17.630435 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:40:17.630435 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:40:17.630435 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:40:17.630435 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:40:17.630435 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:40:17.630435 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:40:17.630435 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:40:17.630435 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:40:17.630435 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:40:17.630435 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:40:17.630435 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:40:17.630435 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:40:17.630435 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:40:17.630435 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:40:17.630435 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:40:17.630435 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:40:17.631357 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:40:17.631357 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:40:17.631357 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:40:17.631357 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:40:17.631357 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:40:17.631357 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:40:17.631357 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:40:17.631357 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:40:17.631357 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:40:17.631357 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:40:17.631357 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:40:17.631357 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:40:17.631357 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:40:17.631357 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:40:17.631357 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 393/793] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:40:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:40:17.636714 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a7a41c-e3bd-47b6-b3dc-b4cb795acf5f None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:17.651657 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:17.740367 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a7a41c-e3bd-47b6-b3dc-b4cb795acf5f None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:17.776960 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093a5ad-92dd-4bd2-806e-36b59a24f5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:17.777644 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093a5ad-92dd-4bd2-806e-36b59a24f5c6 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:17.777981 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093a5ad-92dd-4bd2-806e-36b59a24f5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:17.778261 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093a5ad-92dd-4bd2-806e-36b59a24f5c6 None admin] PATH_INFO: `/v3/services` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:17.778953 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9093a5ad-92dd-4bd2-806e-36b59a24f5c6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:17.779283 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9093a5ad-92dd-4bd2-806e-36b59a24f5c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:17.780787 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9093a5ad-92dd-4bd2-806e-36b59a24f5c6 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:17.785954 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 401/794] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 26 00:40:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:40:17.792680 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8f2e0-f8e9-49c2-889a-fff1f8fb8488 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:17.916616 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8f2e0-f8e9-49c2-889a-fff1f8fb8488 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:17.955095 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a48568-aaa5-4b08-b049-26f684665a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:17.955721 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a48568-aaa5-4b08-b049-26f684665a90 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:17.955994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a48568-aaa5-4b08-b049-26f684665a90 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:17.956267 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a48568-aaa5-4b08-b049-26f684665a90 None admin] PATH_INFO: `/v3/services` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:17.956899 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a48568-aaa5-4b08-b049-26f684665a90 None admin] RBAC: Adding query filter params (type=compute) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:17.957202 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a48568-aaa5-4b08-b049-26f684665a90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:17.958608 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a48568-aaa5-4b08-b049-26f684665a90 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:17.963769 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 394/795] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 26 00:40:17 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:40:18.015338 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a1c42-e8c1-41e5-a17f-29d446f0c7a7 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:18.015630 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a1c42-e8c1-41e5-a17f-29d446f0c7a7 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:18.015931 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a1c42-e8c1-41e5-a17f-29d446f0c7a7 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:18.017387 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 402/796] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:40:18.023573 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7107636-1528-417b-9705-7168c5f24da3 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:18.024529 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7107636-1528-417b-9705-7168c5f24da3 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:18.024818 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7107636-1528-417b-9705-7168c5f24da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:18.044524 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-f7107636-1528-417b-9705-7168c5f24da3 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:18.045803 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-f7107636-1528-417b-9705-7168c5f24da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:18.108860 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:18.121031 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 395/797] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:40:18 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:40:18.453030 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a1c42-e8c1-41e5-a17f-29d446f0c7a7 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:18.539307 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:18.572230 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a1c42-e8c1-41e5-a17f-29d446f0c7a7 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:18.609249 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4ccc0-9beb-44c0-a6ed-ce1fd1abe4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:18.609904 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4ccc0-9beb-44c0-a6ed-ce1fd1abe4b0 None admin] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:18.610187 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4ccc0-9beb-44c0-a6ed-ce1fd1abe4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:18.610460 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4ccc0-9beb-44c0-a6ed-ce1fd1abe4b0 None admin] PATH_INFO: `/v3/projects` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:18.611129 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4ccc0-9beb-44c0-a6ed-ce1fd1abe4b0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:18.612579 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4ccc0-9beb-44c0-a6ed-ce1fd1abe4b0 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:18.615300 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: WARNING keystone.server.flask.common [None req-a5a4ccc0-9beb-44c0-a6ed-ce1fd1abe4b0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 26 00:40:18.668275 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.sql.core [None req-a5a4ccc0-9beb-44c0-a6ed-ce1fd1abe4b0 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 26 00:40:18.668275 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 26 00:40:18.668275 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [parameters: {'id': '053410aaf7ce496e81863c230ef7ab73', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 26 00:40:18.668275 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=95125) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 26 00:40:18.686503 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-a5a4ccc0-9beb-44c0-a6ed-ce1fd1abe4b0 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 053410aaf7ce496e81863c230ef7ab73.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 053410aaf7ce496e81863c230ef7ab73. Aug 26 00:40:18.686503 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:40:18.686503 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 00:40:18.686503 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 00:40:18.686503 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 00:40:18.686503 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 00:40:18.686503 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 00:40:18.686503 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 00:40:18.686503 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 00:40:18.686503 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application conn.query(q) Aug 26 00:40:18.686503 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 00:40:18.686503 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 00:40:18.686503 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 00:40:18.690604 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application result.read() Aug 26 00:40:18.690604 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 00:40:18.690604 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 00:40:18.690604 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 00:40:18.690604 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 00:40:18.690604 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 00:40:18.690604 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 00:40:18.690604 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 00:40:18.690604 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 00:40:18.690604 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 26 00:40:18.690604 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:40:18.690604 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 26 00:40:18.690604 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:40:18.690604 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:40:18.690604 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 26 00:40:18.690604 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 26 00:40:18.690604 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 26 00:40:18.690604 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 26 00:40:18.692067 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 00:40:18.692067 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application next(self.gen) Aug 26 00:40:18.692067 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 26 00:40:18.692067 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application yield resource Aug 26 00:40:18.692067 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 00:40:18.692067 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application next(self.gen) Aug 26 00:40:18.692067 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 26 00:40:18.692067 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application self.session.rollback() Aug 26 00:40:18.692067 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 26 00:40:18.692067 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application self.force_reraise() Aug 26 00:40:18.692067 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 26 00:40:18.692067 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise self.value Aug 26 00:40:18.692067 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 26 00:40:18.692067 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 26 00:40:18.692067 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 26 00:40:18.692067 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application session.commit() Aug 26 00:40:18.692067 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 26 00:40:18.693150 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 26 00:40:18.693150 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 26 00:40:18.693150 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application self._prepare_impl() Aug 26 00:40:18.693150 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 26 00:40:18.693150 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application self.session.flush() Aug 26 00:40:18.693150 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 26 00:40:18.693150 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application self._flush(objects) Aug 26 00:40:18.693150 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 26 00:40:18.693150 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 26 00:40:18.693150 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 26 00:40:18.693150 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application compat.raise_( Aug 26 00:40:18.693150 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 00:40:18.693150 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception Aug 26 00:40:18.693150 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 26 00:40:18.693150 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application flush_context.execute() Aug 26 00:40:18.693150 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 26 00:40:18.693150 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rec.execute(self) Aug 26 00:40:18.694347 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 26 00:40:18.694347 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 26 00:40:18.694347 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 26 00:40:18.694347 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 26 00:40:18.694347 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 26 00:40:18.694347 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 26 00:40:18.694347 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 26 00:40:18.694347 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 26 00:40:18.694347 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 26 00:40:18.694347 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 26 00:40:18.694347 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 26 00:40:18.694347 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 26 00:40:18.694347 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 26 00:40:18.694347 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 26 00:40:18.694347 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 26 00:40:18.695332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 26 00:40:18.695332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 00:40:18.695332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception Aug 26 00:40:18.695332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 00:40:18.695332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 00:40:18.695332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 00:40:18.695332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 00:40:18.695332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 00:40:18.695332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 00:40:18.695332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 00:40:18.695332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application conn.query(q) Aug 26 00:40:18.695332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 00:40:18.695332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 00:40:18.695332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 00:40:18.695332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application result.read() Aug 26 00:40:18.695332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 00:40:18.695332 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 00:40:18.697098 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 00:40:18.697098 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 00:40:18.697098 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 00:40:18.697098 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 00:40:18.697098 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 00:40:18.697098 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 00:40:18.697098 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 26 00:40:18.697098 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 26 00:40:18.697098 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [parameters: {'id': '053410aaf7ce496e81863c230ef7ab73', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 26 00:40:18.697098 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 26 00:40:18.697098 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:40:18.697098 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:40:18.697098 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:40:18.697098 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:40:18.697098 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 26 00:40:18.698259 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 26 00:40:18.698259 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 26 00:40:18.698259 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 26 00:40:18.698259 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 26 00:40:18.698259 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:40:18.698259 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:40:18.698259 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:40:18.698259 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:40:18.698259 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:40:18.698259 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:40:18.698259 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:40:18.698259 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:40:18.698259 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:40:18.698259 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:40:18.698259 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:40:18.698259 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:40:18.698259 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:40:18.699354 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:40:18.699354 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 26 00:40:18.699354 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 26 00:40:18.699354 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:40:18.699354 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:40:18.699354 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 26 00:40:18.699354 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 26 00:40:18.699354 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 053410aaf7ce496e81863c230ef7ab73. Aug 26 00:40:18.699354 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:40:18.699354 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 403/798] 10.222.0.20 () {60 vars in 1140 bytes} [Fri Aug 26 00:40:18 2022] POST /identity/v3/projects => generated 262 bytes in 235 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:40:18.700045 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7107636-1528-417b-9705-7168c5f24da3 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:18.810093 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7107636-1528-417b-9705-7168c5f24da3 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:18.844599 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84796ed-b3a6-4372-bea3-aeb2e95fb639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:18.845057 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84796ed-b3a6-4372-bea3-aeb2e95fb639 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:18.845342 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84796ed-b3a6-4372-bea3-aeb2e95fb639 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:18.845647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84796ed-b3a6-4372-bea3-aeb2e95fb639 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:18.852503 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84796ed-b3a6-4372-bea3-aeb2e95fb639 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:18.854006 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84796ed-b3a6-4372-bea3-aeb2e95fb639 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:18.865018 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-a84796ed-b3a6-4372-bea3-aeb2e95fb639 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:40:18.865018 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:40:18.865018 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:40:18.865018 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:40:18.865018 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:40:18.865018 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:40:18.865018 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:40:18.865018 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:40:18.865018 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:40:18.865018 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:40:18.865018 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:40:18.865018 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:40:18.865018 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:40:18.865018 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:40:18.865018 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:40:18.866032 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:40:18.866032 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:40:18.866032 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:40:18.866032 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:40:18.866032 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:40:18.866032 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:40:18.866032 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:40:18.866032 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:40:18.866032 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:40:18.866032 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:40:18.866032 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:40:18.866032 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:40:18.866032 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:40:18.866032 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:40:18.866032 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:40:18.866032 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:40:18.866032 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:40:18.866950 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:40:18.866950 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:40:18.866950 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:40:18.866950 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:40:18.866950 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:40:18.866950 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:40:18.866950 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:40:18.866950 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:40:18.866950 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 396/799] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:40:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:40:18.872864 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4ccc0-9beb-44c0-a6ed-ce1fd1abe4b0 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:18.982396 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4ccc0-9beb-44c0-a6ed-ce1fd1abe4b0 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:19.013995 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:19.019602 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c40de13-e76d-4933-8d87-ad2f0658db14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:19.027164 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40de13-e76d-4933-8d87-ad2f0658db14 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:19.027164 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40de13-e76d-4933-8d87-ad2f0658db14 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:19.027164 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40de13-e76d-4933-8d87-ad2f0658db14 None admin] PATH_INFO: `/v3/projects` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:19.027164 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c40de13-e76d-4933-8d87-ad2f0658db14 None admin] RBAC: Adding query filter params (name=service) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:19.027164 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c40de13-e76d-4933-8d87-ad2f0658db14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:19.027164 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c40de13-e76d-4933-8d87-ad2f0658db14 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:19.043927 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 404/800] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 26 00:40:18 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:40:20.241999 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb322463-9073-4523-8d73-ecf4be2f0170 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:20.243790 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb322463-9073-4523-8d73-ecf4be2f0170 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:20.243790 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb322463-9073-4523-8d73-ecf4be2f0170 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:20.244546 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 397/801] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:40:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:40:20.250352 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdf0ff-f0dc-4a98-80c6-bf28d4361d30 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:20.250833 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdf0ff-f0dc-4a98-80c6-bf28d4361d30 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:20.251038 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdf0ff-f0dc-4a98-80c6-bf28d4361d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:20.269872 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-22fdf0ff-f0dc-4a98-80c6-bf28d4361d30 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:20.271385 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-22fdf0ff-f0dc-4a98-80c6-bf28d4361d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:20.340256 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 405/802] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:40:20 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:40:20.674739 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb322463-9073-4523-8d73-ecf4be2f0170 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:20.728301 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:20.782008 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb322463-9073-4523-8d73-ecf4be2f0170 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:20.820376 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540802f8-3f71-49ba-8e4a-3ad2c2175d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:20.821638 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540802f8-3f71-49ba-8e4a-3ad2c2175d20 None admin] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:20.821926 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540802f8-3f71-49ba-8e4a-3ad2c2175d20 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:20.822199 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540802f8-3f71-49ba-8e4a-3ad2c2175d20 None admin] PATH_INFO: `/v3/services` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:20.822903 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540802f8-3f71-49ba-8e4a-3ad2c2175d20 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:20.824301 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540802f8-3f71-49ba-8e4a-3ad2c2175d20 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:20.910350 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 398/803] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 26 00:40:20 2022] POST /identity/v3/services => generated 242 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:40:21.311300 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84425a5a-c1e7-4dd9-9fe6-5b1b13391f5a None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:21.311300 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84425a5a-c1e7-4dd9-9fe6-5b1b13391f5a None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:21.311300 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84425a5a-c1e7-4dd9-9fe6-5b1b13391f5a None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:21.311300 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 406/804] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:40:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:40:21.313873 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e752dd-f06b-4f5b-a8ff-cc1d84c9008a None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:21.314274 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e752dd-f06b-4f5b-a8ff-cc1d84c9008a None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:21.314810 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e752dd-f06b-4f5b-a8ff-cc1d84c9008a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:21.334776 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-e0e752dd-f06b-4f5b-a8ff-cc1d84c9008a None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:21.335999 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-e0e752dd-f06b-4f5b-a8ff-cc1d84c9008a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:21.413523 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 399/805] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:40:21 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:40:21.753228 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84425a5a-c1e7-4dd9-9fe6-5b1b13391f5a None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:21.858796 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84425a5a-c1e7-4dd9-9fe6-5b1b13391f5a None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:21.881823 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:21.893526 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebd99f-83c3-4be2-9f15-940db65a20a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:21.898214 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebd99f-83c3-4be2-9f15-940db65a20a3 None admin] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:21.898214 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebd99f-83c3-4be2-9f15-940db65a20a3 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:21.898214 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebd99f-83c3-4be2-9f15-940db65a20a3 None admin] PATH_INFO: `/v3/users` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:21.898214 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eebd99f-83c3-4be2-9f15-940db65a20a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:21.898214 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eebd99f-83c3-4be2-9f15-940db65a20a3 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:21.942330 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.sql.core [None req-3eebd99f-83c3-4be2-9f15-940db65a20a3 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 26 00:40:21.942330 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 26 00:40:21.942330 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [parameters: {'user_id': 'f6950ef8803a4c4b85d44fc4dde73f71', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 26 00:40:21.942330 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=95125) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 26 00:40:21.949599 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-3eebd99f-83c3-4be2-9f15-940db65a20a3 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 26 00:40:21.949599 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:40:21.949599 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 00:40:21.949599 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 00:40:21.949599 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 00:40:21.949599 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 00:40:21.949599 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 00:40:21.949599 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 00:40:21.949599 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 00:40:21.949599 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application conn.query(q) Aug 26 00:40:21.949599 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 00:40:21.949599 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 00:40:21.949599 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 00:40:21.949599 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application result.read() Aug 26 00:40:21.949599 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 00:40:21.950682 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 00:40:21.950682 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 00:40:21.950682 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 00:40:21.950682 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 00:40:21.950682 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 00:40:21.950682 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 00:40:21.950682 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 00:40:21.950682 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 26 00:40:21.950682 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:40:21.950682 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 26 00:40:21.950682 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:40:21.950682 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:40:21.950682 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 26 00:40:21.950682 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 26 00:40:21.950682 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 26 00:40:21.950682 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 26 00:40:21.950682 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 00:40:21.950682 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application next(self.gen) Aug 26 00:40:21.952070 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 26 00:40:21.952070 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application yield resource Aug 26 00:40:21.952070 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 00:40:21.952070 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application next(self.gen) Aug 26 00:40:21.952070 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 26 00:40:21.952070 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application self.session.rollback() Aug 26 00:40:21.952070 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 26 00:40:21.952070 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application self.force_reraise() Aug 26 00:40:21.952070 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 26 00:40:21.952070 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise self.value Aug 26 00:40:21.952070 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 26 00:40:21.952070 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 26 00:40:21.952070 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 26 00:40:21.952070 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application session.commit() Aug 26 00:40:21.952070 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 26 00:40:21.952070 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 26 00:40:21.952070 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 26 00:40:21.953034 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application self._prepare_impl() Aug 26 00:40:21.953034 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 26 00:40:21.953034 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application self.session.flush() Aug 26 00:40:21.953034 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 26 00:40:21.953034 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application self._flush(objects) Aug 26 00:40:21.953034 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 26 00:40:21.953034 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 26 00:40:21.953034 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 26 00:40:21.953034 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application compat.raise_( Aug 26 00:40:21.953034 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 00:40:21.953034 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception Aug 26 00:40:21.953034 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 26 00:40:21.953034 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application flush_context.execute() Aug 26 00:40:21.953034 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 26 00:40:21.953034 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rec.execute(self) Aug 26 00:40:21.953034 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 26 00:40:21.953034 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 26 00:40:21.954276 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 26 00:40:21.954276 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 26 00:40:21.954276 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 26 00:40:21.954276 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 26 00:40:21.954276 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 26 00:40:21.954276 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 26 00:40:21.954276 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 26 00:40:21.954276 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 26 00:40:21.954276 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 26 00:40:21.954276 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 26 00:40:21.954276 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 26 00:40:21.954276 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 26 00:40:21.954276 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 26 00:40:21.954276 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 26 00:40:21.954276 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 00:40:21.954276 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception Aug 26 00:40:21.955411 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 00:40:21.955411 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 00:40:21.955411 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 00:40:21.955411 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 00:40:21.955411 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 00:40:21.955411 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 00:40:21.955411 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 00:40:21.955411 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application conn.query(q) Aug 26 00:40:21.955411 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 00:40:21.955411 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 00:40:21.955411 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 00:40:21.955411 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application result.read() Aug 26 00:40:21.955411 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 00:40:21.955411 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 00:40:21.955411 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 00:40:21.955411 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 00:40:21.956685 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 00:40:21.956685 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 00:40:21.956685 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 00:40:21.956685 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 00:40:21.956685 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 26 00:40:21.956685 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 26 00:40:21.956685 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f6950ef8803a4c4b85d44fc4dde73f71', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 26 00:40:21.956685 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 26 00:40:21.956685 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:40:21.956685 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:40:21.956685 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:40:21.956685 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:40:21.956685 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:40:21.956685 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:40:21.956685 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:40:21.957707 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:40:21.957707 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:40:21.957707 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:40:21.957707 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:40:21.957707 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:40:21.957707 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:40:21.957707 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:40:21.957707 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 26 00:40:21.957707 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 26 00:40:21.957707 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:40:21.957707 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:40:21.957707 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:40:21.957707 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:40:21.957707 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:40:21.957707 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:40:21.957707 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 26 00:40:21.957707 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 26 00:40:21.958795 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 26 00:40:21.958795 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 26 00:40:21.958795 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 26 00:40:21.958795 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 26 00:40:21.958795 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 26 00:40:21.958795 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:40:21.958795 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 407/806] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Aug 26 00:40:21 2022] POST /identity/v3/users => generated 160 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:40:21.959497 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e752dd-f06b-4f5b-a8ff-cc1d84c9008a None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:21.992904 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:22.062116 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e752dd-f06b-4f5b-a8ff-cc1d84c9008a None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:22.096685 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65673fb2-db2d-42db-ba84-b4fc584bddbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:22.097610 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65673fb2-db2d-42db-ba84-b4fc584bddbe None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:22.098428 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65673fb2-db2d-42db-ba84-b4fc584bddbe None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:22.098700 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65673fb2-db2d-42db-ba84-b4fc584bddbe None admin] PATH_INFO: `/v3/users/cinder` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:22.106937 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65673fb2-db2d-42db-ba84-b4fc584bddbe None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:22.108398 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65673fb2-db2d-42db-ba84-b4fc584bddbe None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:22.120883 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-65673fb2-db2d-42db-ba84-b4fc584bddbe None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 00:40:22.120883 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:40:22.120883 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:40:22.120883 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:40:22.120883 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:40:22.120883 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:40:22.120883 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:40:22.120883 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:40:22.120883 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:40:22.120883 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:40:22.120883 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:40:22.120883 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:40:22.120883 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:40:22.120883 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:40:22.120883 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:40:22.120883 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:40:22.121994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:40:22.121994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:40:22.121994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:40:22.121994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:40:22.121994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:40:22.121994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:40:22.121994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:40:22.121994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:40:22.121994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:40:22.121994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:40:22.121994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:40:22.121994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:40:22.121994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:40:22.121994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:40:22.121994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:40:22.121994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:40:22.121994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:40:22.121994 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:40:22.122945 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:40:22.122945 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:40:22.122945 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:40:22.122945 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:40:22.122945 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:40:22.122945 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:40:22.122945 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:40:22.122945 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:40:22.122945 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 00:40:22.122945 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:40:22.122945 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 400/807] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:40:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:40:22.128006 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebd99f-83c3-4be2-9f15-940db65a20a3 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:22.229522 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebd99f-83c3-4be2-9f15-940db65a20a3 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:22.263350 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb084d6-a2a6-4c9b-be62-5d213424cb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:22.263944 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb084d6-a2a6-4c9b-be62-5d213424cb82 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:22.264222 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb084d6-a2a6-4c9b-be62-5d213424cb82 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:22.264490 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb084d6-a2a6-4c9b-be62-5d213424cb82 None admin] PATH_INFO: `/v3/users` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:22.265189 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb084d6-a2a6-4c9b-be62-5d213424cb82 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:22.265517 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb084d6-a2a6-4c9b-be62-5d213424cb82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:22.267124 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb084d6-a2a6-4c9b-be62-5d213424cb82 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:22.310209 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 408/808] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 26 00:40:22 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:40:23.161657 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e267ca-5c60-46b2-b2ec-a9d255e6c17e None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:23.162205 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e267ca-5c60-46b2-b2ec-a9d255e6c17e None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:23.162205 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e267ca-5c60-46b2-b2ec-a9d255e6c17e None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:23.163541 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 401/809] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:40:23.170158 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a7e25-b4c2-4605-8970-28ebfff9f524 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:23.170641 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a7e25-b4c2-4605-8970-28ebfff9f524 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:23.170741 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a7e25-b4c2-4605-8970-28ebfff9f524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:23.190451 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-948a7e25-b4c2-4605-8970-28ebfff9f524 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:23.191986 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-948a7e25-b4c2-4605-8970-28ebfff9f524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:23.230284 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:23.262373 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 409/810] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:40:23 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:40:23.590034 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e267ca-5c60-46b2-b2ec-a9d255e6c17e None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:23.703170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:23.710652 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e267ca-5c60-46b2-b2ec-a9d255e6c17e None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:23.756147 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a63f49-6dc9-4bde-9a30-a9f8f84ea94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:23.756791 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a63f49-6dc9-4bde-9a30-a9f8f84ea94e None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:23.757077 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a63f49-6dc9-4bde-9a30-a9f8f84ea94e None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:23.757351 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a63f49-6dc9-4bde-9a30-a9f8f84ea94e None admin] PATH_INFO: `/v3/services/compute` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:23.757979 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a63f49-6dc9-4bde-9a30-a9f8f84ea94e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:23.760366 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a63f49-6dc9-4bde-9a30-a9f8f84ea94e None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:23.769674 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-95a63f49-6dc9-4bde-9a30-a9f8f84ea94e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:40:23.769674 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:40:23.769674 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:40:23.769674 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:40:23.769674 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:40:23.769674 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:40:23.769674 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:40:23.769674 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:40:23.769674 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:40:23.769674 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:40:23.769674 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:40:23.769674 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:40:23.769674 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:40:23.769674 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:40:23.769674 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:40:23.769674 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:40:23.769674 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:40:23.770832 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:40:23.770832 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:40:23.770832 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:40:23.770832 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:40:23.770832 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:40:23.770832 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:40:23.770832 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:40:23.770832 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:40:23.770832 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:40:23.770832 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:40:23.770832 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:40:23.770832 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:40:23.770832 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:40:23.770832 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:40:23.770832 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:40:23.770832 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:40:23.772104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:40:23.772104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:40:23.772104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:40:23.772104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:40:23.772104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:40:23.772104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:40:23.772104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:40:23.772104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:40:23.772104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:40:23.772104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:40:23.772104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:40:23.772104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:40:23.772104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:40:23.772104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:40:23.772104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 402/811] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:40:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:40:23.778128 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a7e25-b4c2-4605-8970-28ebfff9f524 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:23.891401 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a7e25-b4c2-4605-8970-28ebfff9f524 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:23.930034 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfd418-32fa-4108-a581-c8f718ae264b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:23.930639 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfd418-32fa-4108-a581-c8f718ae264b None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:23.930922 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfd418-32fa-4108-a581-c8f718ae264b None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:23.931200 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfd418-32fa-4108-a581-c8f718ae264b None admin] PATH_INFO: `/v3/services` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:23.931829 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bfd418-32fa-4108-a581-c8f718ae264b None admin] RBAC: Adding query filter params (name=compute) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:23.932172 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bfd418-32fa-4108-a581-c8f718ae264b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:23.933758 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bfd418-32fa-4108-a581-c8f718ae264b None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:23.938628 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 410/812] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 26 00:40:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:40:23.944355 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a63f49-6dc9-4bde-9a30-a9f8f84ea94e None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:24.047851 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a63f49-6dc9-4bde-9a30-a9f8f84ea94e None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:24.083991 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb609a-4d25-42b0-8578-fc37e0fff7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:24.084594 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb609a-4d25-42b0-8578-fc37e0fff7e9 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:24.084875 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb609a-4d25-42b0-8578-fc37e0fff7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:24.085150 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb609a-4d25-42b0-8578-fc37e0fff7e9 None admin] PATH_INFO: `/v3/services` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:24.085811 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb609a-4d25-42b0-8578-fc37e0fff7e9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:24.086151 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb609a-4d25-42b0-8578-fc37e0fff7e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:24.087532 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb609a-4d25-42b0-8578-fc37e0fff7e9 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:24.092335 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 403/813] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 26 00:40:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:40:24.098739 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfd418-32fa-4108-a581-c8f718ae264b None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:24.140086 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:24.206566 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfd418-32fa-4108-a581-c8f718ae264b None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:24.243897 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8080ae-cfa5-4111-9824-6df8fcc3de30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:24.244571 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8080ae-cfa5-4111-9824-6df8fcc3de30 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:24.244855 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8080ae-cfa5-4111-9824-6df8fcc3de30 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:24.245157 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8080ae-cfa5-4111-9824-6df8fcc3de30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:24.245901 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8080ae-cfa5-4111-9824-6df8fcc3de30 None admin] RBAC: Adding query filter params (interface=public, service_id=5aa8bc0dd82e40cf9550315271c25f77, region_id=RegionOne) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:24.246241 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8080ae-cfa5-4111-9824-6df8fcc3de30 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:24.247636 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8080ae-cfa5-4111-9824-6df8fcc3de30 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:24.252867 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 411/814] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Aug 26 00:40:24 2022] GET /identity/v3/endpoints?service_id=5aa8bc0dd82e40cf9550315271c25f77&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:40:24.259342 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb609a-4d25-42b0-8578-fc37e0fff7e9 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:24.285867 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:24.360963 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb609a-4d25-42b0-8578-fc37e0fff7e9 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:24.398401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59562f2-a55c-4b3e-972e-57cf5a2e1d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:24.399492 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59562f2-a55c-4b3e-972e-57cf5a2e1d36 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:24.399801 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59562f2-a55c-4b3e-972e-57cf5a2e1d36 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:24.400127 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59562f2-a55c-4b3e-972e-57cf5a2e1d36 None admin] PATH_INFO: `/v3/services` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:24.400752 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59562f2-a55c-4b3e-972e-57cf5a2e1d36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:24.402206 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59562f2-a55c-4b3e-972e-57cf5a2e1d36 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:24.409337 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 404/815] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Aug 26 00:40:24 2022] GET /identity/v3/services => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:40:26.618643 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6477c-e5a8-4524-b89c-13093f38680a None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:26.619218 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6477c-e5a8-4524-b89c-13093f38680a None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:26.619456 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6477c-e5a8-4524-b89c-13093f38680a None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:26.621640 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 412/816] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:40:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:40:26.627380 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15e9fa-9b56-42af-b5b6-8d259dc60e2d None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:26.627796 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15e9fa-9b56-42af-b5b6-8d259dc60e2d None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:26.627934 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15e9fa-9b56-42af-b5b6-8d259dc60e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:26.646572 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-3d15e9fa-9b56-42af-b5b6-8d259dc60e2d None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:26.647793 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-3d15e9fa-9b56-42af-b5b6-8d259dc60e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:26.718397 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 405/817] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:40:26 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:40:27.050845 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6477c-e5a8-4524-b89c-13093f38680a None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:27.154423 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:27.158348 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6477c-e5a8-4524-b89c-13093f38680a None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:27.193820 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f38470-b278-465c-9a95-e0cd595b1e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:27.194357 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f38470-b278-465c-9a95-e0cd595b1e31 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:27.194736 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f38470-b278-465c-9a95-e0cd595b1e31 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:27.194907 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f38470-b278-465c-9a95-e0cd595b1e31 None admin] PATH_INFO: `/v3/services/compute` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:27.196150 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f38470-b278-465c-9a95-e0cd595b1e31 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:27.197663 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f38470-b278-465c-9a95-e0cd595b1e31 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:27.206957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-a2f38470-b278-465c-9a95-e0cd595b1e31 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:40:27.206957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:40:27.206957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:40:27.206957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:40:27.206957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:40:27.206957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:40:27.206957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:40:27.206957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:40:27.206957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:40:27.206957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:40:27.206957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:40:27.206957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:40:27.206957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:40:27.206957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:40:27.206957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:40:27.206957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:40:27.206957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:40:27.208169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:40:27.208169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:40:27.208169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:40:27.208169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:40:27.208169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:40:27.208169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:40:27.208169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:40:27.208169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:40:27.208169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:40:27.208169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:40:27.208169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:40:27.208169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:40:27.208169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:40:27.208169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:40:27.208169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:40:27.208169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:40:27.209008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:40:27.209008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:40:27.209008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:40:27.209008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:40:27.209008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:40:27.209008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:40:27.209008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:40:27.209008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:40:27.209008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:40:27.209008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:40:27.209008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:40:27.209008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:40:27.209008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:40:27.209008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:40:27.209008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 413/818] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:40:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:40:27.214376 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15e9fa-9b56-42af-b5b6-8d259dc60e2d None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:27.232665 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:27.322090 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15e9fa-9b56-42af-b5b6-8d259dc60e2d None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:27.357101 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550d593-6a8c-42f0-bbaf-a58c3dbc3d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:27.357757 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550d593-6a8c-42f0-bbaf-a58c3dbc3d63 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:27.358041 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550d593-6a8c-42f0-bbaf-a58c3dbc3d63 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:27.358315 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550d593-6a8c-42f0-bbaf-a58c3dbc3d63 None admin] PATH_INFO: `/v3/services` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:27.358952 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550d593-6a8c-42f0-bbaf-a58c3dbc3d63 None admin] RBAC: Adding query filter params (name=compute) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:27.359258 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550d593-6a8c-42f0-bbaf-a58c3dbc3d63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:27.360634 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550d593-6a8c-42f0-bbaf-a58c3dbc3d63 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:27.365580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 406/819] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 26 00:40:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:40:27.372222 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f38470-b278-465c-9a95-e0cd595b1e31 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:27.473816 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f38470-b278-465c-9a95-e0cd595b1e31 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:27.509255 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafb68e-bc0a-4e88-8e79-764c987dae60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:27.509907 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafb68e-bc0a-4e88-8e79-764c987dae60 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:27.510179 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafb68e-bc0a-4e88-8e79-764c987dae60 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:27.510455 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafb68e-bc0a-4e88-8e79-764c987dae60 None admin] PATH_INFO: `/v3/services` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:27.511087 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aafb68e-bc0a-4e88-8e79-764c987dae60 None admin] RBAC: Adding query filter params (type=compute) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:27.511393 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aafb68e-bc0a-4e88-8e79-764c987dae60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:27.512767 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aafb68e-bc0a-4e88-8e79-764c987dae60 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:27.518227 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 414/820] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 26 00:40:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:40:27.525179 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550d593-6a8c-42f0-bbaf-a58c3dbc3d63 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:27.608037 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:27.626444 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550d593-6a8c-42f0-bbaf-a58c3dbc3d63 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:27.662649 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e48fd4-d1fc-4a3b-89c3-50c31d83de33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:27.663361 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e48fd4-d1fc-4a3b-89c3-50c31d83de33 None admin] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:27.663575 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e48fd4-d1fc-4a3b-89c3-50c31d83de33 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:27.663853 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e48fd4-d1fc-4a3b-89c3-50c31d83de33 None admin] PATH_INFO: `/v3/endpoints` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:27.664754 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e48fd4-d1fc-4a3b-89c3-50c31d83de33 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:27.666194 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e48fd4-d1fc-4a3b-89c3-50c31d83de33 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:27.784646 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 407/821] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 00:40:27 2022] POST /identity/v3/endpoints => generated 334 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:40:37.515193 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=86 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:37.779426 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:41:58.390757 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e81de-4369-491d-bac6-e8f72a889a7d None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:58.391313 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e81de-4369-491d-bac6-e8f72a889a7d None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:58.391313 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e81de-4369-491d-bac6-e8f72a889a7d None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:58.392492 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 415/822] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:41:58.398313 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bdee0-c335-4e5d-83d0-94bd030db7f9 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:58.398804 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bdee0-c335-4e5d-83d0-94bd030db7f9 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:58.398969 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bdee0-c335-4e5d-83d0-94bd030db7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:58.419562 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-4b1bdee0-c335-4e5d-83d0-94bd030db7f9 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:41:58.420791 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-4b1bdee0-c335-4e5d-83d0-94bd030db7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:41:58.500144 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 408/823] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:41:58 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:41:58.830335 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e81de-4369-491d-bac6-e8f72a889a7d None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:41:58.937447 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e81de-4369-491d-bac6-e8f72a889a7d None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:41:58.973693 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47edf9dc-2e54-41f1-b54b-132c74e95371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:41:58.976761 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edf9dc-2e54-41f1-b54b-132c74e95371 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:58.976761 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edf9dc-2e54-41f1-b54b-132c74e95371 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:58.976761 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edf9dc-2e54-41f1-b54b-132c74e95371 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:58.986449 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47edf9dc-2e54-41f1-b54b-132c74e95371 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:41:58.987911 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47edf9dc-2e54-41f1-b54b-132c74e95371 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:41:59.002851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-47edf9dc-2e54-41f1-b54b-132c74e95371 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:41:59.002851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:41:59.002851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:41:59.002851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:41:59.002851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:41:59.002851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:41:59.002851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:41:59.002851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:41:59.002851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:41:59.002851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:41:59.002851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:41:59.002851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:41:59.002851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:41:59.002851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:41:59.002851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:41:59.002851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:41:59.004174 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:41:59.004174 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:41:59.004174 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:41:59.004174 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:41:59.004174 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:41:59.004174 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:41:59.004174 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:41:59.004174 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:41:59.004174 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:41:59.004174 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:41:59.004174 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:41:59.004174 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:41:59.004174 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:41:59.004174 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:41:59.004174 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:41:59.004174 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:41:59.004174 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:41:59.005229 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:41:59.005229 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:41:59.005229 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:41:59.005229 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 416/824] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:41:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:41:59.011129 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bdee0-c335-4e5d-83d0-94bd030db7f9 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:41:59.115715 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bdee0-c335-4e5d-83d0-94bd030db7f9 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:41:59.144635 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:41:59.155171 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8404c19-3a79-46d1-a807-fa8dbce7191e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:41:59.155698 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8404c19-3a79-46d1-a807-fa8dbce7191e None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:59.155980 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8404c19-3a79-46d1-a807-fa8dbce7191e None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:59.156258 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8404c19-3a79-46d1-a807-fa8dbce7191e None admin] PATH_INFO: `/v3/domains` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:59.156963 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8404c19-3a79-46d1-a807-fa8dbce7191e None admin] RBAC: Adding query filter params (name=Default) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:41:59.157270 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8404c19-3a79-46d1-a807-fa8dbce7191e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:41:59.158805 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8404c19-3a79-46d1-a807-fa8dbce7191e None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:41:59.171592 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 409/825] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:41:59.177820 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47edf9dc-2e54-41f1-b54b-132c74e95371 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:41:59.235560 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:41:59.283452 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47edf9dc-2e54-41f1-b54b-132c74e95371 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:41:59.317973 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fada04-3fe7-49f2-85f7-ae534242d510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:41:59.318593 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fada04-3fe7-49f2-85f7-ae534242d510 None admin] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:59.318893 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fada04-3fe7-49f2-85f7-ae534242d510 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:59.319640 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fada04-3fe7-49f2-85f7-ae534242d510 None admin] PATH_INFO: `/v3/users` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:59.320300 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fada04-3fe7-49f2-85f7-ae534242d510 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:41:59.321774 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fada04-3fe7-49f2-85f7-ae534242d510 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:41:59.501951 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 417/826] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 26 00:41:59 2022] POST /identity/v3/users => generated 251 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:42:01.788849 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9d878-162b-4e41-b387-8deee71266df None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:01.789447 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9d878-162b-4e41-b387-8deee71266df None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:01.789447 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9d878-162b-4e41-b387-8deee71266df None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:01.790756 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 410/827] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:42:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:42:01.796178 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e895d-2f50-4a0c-b56d-1d7ff2832803 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:01.796679 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e895d-2f50-4a0c-b56d-1d7ff2832803 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:01.796784 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e895d-2f50-4a0c-b56d-1d7ff2832803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:01.815330 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-380e895d-2f50-4a0c-b56d-1d7ff2832803 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:42:01.816549 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-380e895d-2f50-4a0c-b56d-1d7ff2832803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:42:01.887813 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 418/828] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:42:01 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:42:02.218330 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9d878-162b-4e41-b387-8deee71266df None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:02.324275 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9d878-162b-4e41-b387-8deee71266df None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:02.359889 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83360c9c-3942-4ad8-9b0d-e975ed5c1883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:02.360528 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83360c9c-3942-4ad8-9b0d-e975ed5c1883 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:02.360799 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83360c9c-3942-4ad8-9b0d-e975ed5c1883 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:02.361077 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83360c9c-3942-4ad8-9b0d-e975ed5c1883 None admin] PATH_INFO: `/v3/roles/service` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:02.373252 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83360c9c-3942-4ad8-9b0d-e975ed5c1883 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:42:02.378047 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-83360c9c-3942-4ad8-9b0d-e975ed5c1883 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:42:02.378047 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:02.378047 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:42:02.378047 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:42:02.378047 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:42:02.378047 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:42:02.378047 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:42:02.378047 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:42:02.378047 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:42:02.378047 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:42:02.378047 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:42:02.378047 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:42:02.378047 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:42:02.378047 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:42:02.378047 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:42:02.378047 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:42:02.379216 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:42:02.379216 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:42:02.379216 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:42:02.379216 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:42:02.379216 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:42:02.379216 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:42:02.379216 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:42:02.379216 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:42:02.379216 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:42:02.379216 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:42:02.379216 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:42:02.379216 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:42:02.379216 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:42:02.379216 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:42:02.379216 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:42:02.379216 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:42:02.380573 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:42:02.380573 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:42:02.380573 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:42:02.380573 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:42:02.380573 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:42:02.380573 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:42:02.380573 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:42:02.380573 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:42:02.380573 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:42:02.380573 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:42:02.380573 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:42:02.380573 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:42:02.380573 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 411/829] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 00:42:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:42:02.385779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e895d-2f50-4a0c-b56d-1d7ff2832803 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:02.427769 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:02.488757 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e895d-2f50-4a0c-b56d-1d7ff2832803 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:02.528294 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1c268-1837-4044-bef3-f62d6b9f9e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:02.528905 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1c268-1837-4044-bef3-f62d6b9f9e54 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:02.529179 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1c268-1837-4044-bef3-f62d6b9f9e54 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:02.529482 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1c268-1837-4044-bef3-f62d6b9f9e54 None admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:02.530160 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1c268-1837-4044-bef3-f62d6b9f9e54 None admin] RBAC: Adding query filter params (name=service) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:02.530461 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1c268-1837-4044-bef3-f62d6b9f9e54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:02.531843 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1c268-1837-4044-bef3-f62d6b9f9e54 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:02.541965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 419/830] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 00:42:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:02.548374 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83360c9c-3942-4ad8-9b0d-e975ed5c1883 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:02.598693 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:02.659172 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83360c9c-3942-4ad8-9b0d-e975ed5c1883 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:02.693811 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ac1b6-9cca-413c-ba24-a9c3e93a5657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:02.694452 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ac1b6-9cca-413c-ba24-a9c3e93a5657 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:02.694733 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ac1b6-9cca-413c-ba24-a9c3e93a5657 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:02.695005 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ac1b6-9cca-413c-ba24-a9c3e93a5657 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:02.706205 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ac1b6-9cca-413c-ba24-a9c3e93a5657 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:02.707712 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ac1b6-9cca-413c-ba24-a9c3e93a5657 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:02.722758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-f14ac1b6-9cca-413c-ba24-a9c3e93a5657 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:42:02.722758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:02.722758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:42:02.722758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:42:02.722758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:42:02.722758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:42:02.722758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:42:02.722758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:42:02.722758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:42:02.722758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:42:02.722758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:42:02.722758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:42:02.722758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:42:02.722758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:42:02.722758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:42:02.722758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:42:02.723937 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:42:02.723937 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:42:02.723937 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:42:02.723937 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:42:02.723937 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:42:02.723937 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:42:02.723937 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:42:02.723937 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:42:02.723937 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:42:02.723937 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:42:02.723937 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:42:02.723937 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:42:02.723937 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:42:02.723937 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:42:02.723937 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:42:02.723937 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:42:02.723937 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:42:02.725068 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:42:02.725068 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:42:02.725068 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:42:02.725068 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 412/831] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:42:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:42:02.730163 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1c268-1837-4044-bef3-f62d6b9f9e54 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:02.841130 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:02.844189 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1c268-1837-4044-bef3-f62d6b9f9e54 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:02.881235 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecfc9d-3008-402b-a8ce-e5cdc3e0a0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:02.881901 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecfc9d-3008-402b-a8ce-e5cdc3e0a0d5 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:02.882180 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecfc9d-3008-402b-a8ce-e5cdc3e0a0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:02.882454 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecfc9d-3008-402b-a8ce-e5cdc3e0a0d5 None admin] PATH_INFO: `/v3/domains` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:02.883113 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afecfc9d-3008-402b-a8ce-e5cdc3e0a0d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:02.883417 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afecfc9d-3008-402b-a8ce-e5cdc3e0a0d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:02.884801 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afecfc9d-3008-402b-a8ce-e5cdc3e0a0d5 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:02.898190 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 420/832] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:02.904039 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ac1b6-9cca-413c-ba24-a9c3e93a5657 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:03.006951 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:03.010967 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ac1b6-9cca-413c-ba24-a9c3e93a5657 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:03.046211 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab6132-4071-42dc-8f70-11068f985f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:03.046850 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab6132-4071-42dc-8f70-11068f985f47 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:03.047136 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab6132-4071-42dc-8f70-11068f985f47 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:03.047436 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab6132-4071-42dc-8f70-11068f985f47 None admin] PATH_INFO: `/v3/users/placement` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:03.056977 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab6132-4071-42dc-8f70-11068f985f47 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:03.058490 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab6132-4071-42dc-8f70-11068f985f47 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:03.070355 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-f6ab6132-4071-42dc-8f70-11068f985f47 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:42:03.070355 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:03.070355 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:42:03.070355 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:42:03.070355 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:42:03.070355 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:42:03.070355 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:42:03.070355 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:42:03.070355 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:42:03.070355 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:42:03.070355 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:42:03.070355 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:42:03.070355 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:42:03.070355 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:42:03.070355 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:42:03.070355 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:42:03.071496 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:42:03.071496 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:42:03.071496 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:42:03.071496 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:42:03.071496 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:42:03.071496 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:42:03.071496 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:42:03.071496 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:42:03.071496 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:42:03.071496 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:42:03.071496 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:42:03.071496 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:42:03.071496 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:42:03.071496 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:42:03.071496 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:42:03.071496 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:42:03.071496 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:42:03.071496 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:42:03.072695 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:42:03.072695 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:42:03.072695 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:42:03.072695 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:42:03.072695 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:42:03.072695 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:42:03.072695 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:42:03.072695 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:42:03.072695 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:42:03.072695 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:42:03.072695 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 413/833] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:42:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:42:03.077570 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecfc9d-3008-402b-a8ce-e5cdc3e0a0d5 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:03.183025 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecfc9d-3008-402b-a8ce-e5cdc3e0a0d5 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:03.217147 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47434640-a24d-43a7-ad7e-3baa3223e312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:03.217778 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47434640-a24d-43a7-ad7e-3baa3223e312 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:03.218059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47434640-a24d-43a7-ad7e-3baa3223e312 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:03.218329 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47434640-a24d-43a7-ad7e-3baa3223e312 None admin] PATH_INFO: `/v3/users` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:03.219053 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47434640-a24d-43a7-ad7e-3baa3223e312 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:03.219378 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47434640-a24d-43a7-ad7e-3baa3223e312 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:03.220785 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47434640-a24d-43a7-ad7e-3baa3223e312 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:03.238315 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 421/834] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Aug 26 00:42:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:03.246810 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab6132-4071-42dc-8f70-11068f985f47 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:03.364228 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab6132-4071-42dc-8f70-11068f985f47 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:03.401566 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99206aa-6851-45e8-96ea-8fcc4ef8237f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:03.402186 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99206aa-6851-45e8-96ea-8fcc4ef8237f None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:03.402477 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99206aa-6851-45e8-96ea-8fcc4ef8237f None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:03.402750 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99206aa-6851-45e8-96ea-8fcc4ef8237f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:03.431782 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:03.472234 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99206aa-6851-45e8-96ea-8fcc4ef8237f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:03.473784 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99206aa-6851-45e8-96ea-8fcc4ef8237f None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:03.573517 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 414/835] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:42:03 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:42:03.579581 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47434640-a24d-43a7-ad7e-3baa3223e312 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:03.599799 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:03.692864 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47434640-a24d-43a7-ad7e-3baa3223e312 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:03.728223 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9135c9-ef30-4272-814f-b04ba451ab2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:03.728803 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9135c9-ef30-4272-814f-b04ba451ab2c None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:03.729082 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9135c9-ef30-4272-814f-b04ba451ab2c None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:03.729357 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9135c9-ef30-4272-814f-b04ba451ab2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:03.739542 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9135c9-ef30-4272-814f-b04ba451ab2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:03.741082 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9135c9-ef30-4272-814f-b04ba451ab2c None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:03.755423 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-7a9135c9-ef30-4272-814f-b04ba451ab2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:42:03.755423 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:03.755423 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:42:03.755423 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:42:03.755423 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:42:03.755423 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:42:03.755423 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:42:03.755423 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:42:03.755423 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:42:03.755423 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:42:03.755423 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:42:03.755423 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:42:03.755423 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:42:03.755423 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:42:03.755423 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:42:03.755423 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:42:03.761403 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:42:03.761403 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:42:03.761403 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:42:03.761403 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:42:03.761403 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:42:03.761403 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:42:03.761403 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:42:03.761403 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:42:03.761403 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:42:03.761403 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:42:03.761403 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:42:03.761403 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:42:03.761403 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:42:03.761403 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:42:03.761403 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:42:03.761403 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:42:03.761403 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:42:03.762410 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:42:03.762410 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:42:03.762410 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:42:03.762410 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 422/836] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:42:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:42:03.762649 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99206aa-6851-45e8-96ea-8fcc4ef8237f None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:03.824944 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:03.868004 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99206aa-6851-45e8-96ea-8fcc4ef8237f None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:03.902005 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e00d03-cf31-4e99-8366-cf0923597634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:03.902609 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e00d03-cf31-4e99-8366-cf0923597634 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:03.902890 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e00d03-cf31-4e99-8366-cf0923597634 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:03.903164 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e00d03-cf31-4e99-8366-cf0923597634 None admin] PATH_INFO: `/v3/domains` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:03.903808 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e00d03-cf31-4e99-8366-cf0923597634 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:03.904117 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e00d03-cf31-4e99-8366-cf0923597634 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:03.905685 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e00d03-cf31-4e99-8366-cf0923597634 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:03.918524 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 415/837] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:03.924405 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9135c9-ef30-4272-814f-b04ba451ab2c None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:03.996709 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:04.028063 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9135c9-ef30-4272-814f-b04ba451ab2c None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:04.062294 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bfb4c5-d8dc-49e2-ac65-22f758ca362c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:04.062926 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfb4c5-d8dc-49e2-ac65-22f758ca362c None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:04.063210 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfb4c5-d8dc-49e2-ac65-22f758ca362c None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:04.063488 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfb4c5-d8dc-49e2-ac65-22f758ca362c None admin] PATH_INFO: `/v3/projects/service` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:04.070225 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bfb4c5-d8dc-49e2-ac65-22f758ca362c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:04.071677 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bfb4c5-d8dc-49e2-ac65-22f758ca362c None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:04.082755 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-91bfb4c5-d8dc-49e2-ac65-22f758ca362c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:42:04.082755 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:04.082755 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:42:04.082755 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:42:04.082755 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:42:04.082755 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:42:04.082755 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:42:04.082755 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:42:04.082755 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:42:04.082755 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:42:04.082755 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:42:04.082755 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:42:04.082755 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:42:04.082755 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:42:04.082755 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:42:04.084328 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:42:04.084328 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:42:04.084328 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:42:04.084328 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:42:04.084328 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:42:04.084328 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:42:04.084328 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:42:04.084328 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:42:04.084328 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:42:04.084328 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:42:04.084328 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:42:04.084328 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:42:04.084328 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:42:04.084328 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:42:04.084328 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:42:04.084328 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:42:04.084328 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:42:04.085692 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:42:04.085692 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:42:04.085692 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:42:04.085692 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:42:04.085692 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:42:04.085692 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:42:04.085692 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:42:04.085692 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:42:04.085692 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 423/838] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:42:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:42:04.090497 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e00d03-cf31-4e99-8366-cf0923597634 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:04.192371 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e00d03-cf31-4e99-8366-cf0923597634 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:04.210758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:04.227418 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3fbf00-64d9-4bda-8f2a-36ae91ce1079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:04.228025 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fbf00-64d9-4bda-8f2a-36ae91ce1079 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:04.228310 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fbf00-64d9-4bda-8f2a-36ae91ce1079 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:04.228590 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fbf00-64d9-4bda-8f2a-36ae91ce1079 None admin] PATH_INFO: `/v3/projects` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:04.229282 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3fbf00-64d9-4bda-8f2a-36ae91ce1079 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:04.229634 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3fbf00-64d9-4bda-8f2a-36ae91ce1079 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:04.231067 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3fbf00-64d9-4bda-8f2a-36ae91ce1079 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:04.243167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 416/839] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 00:42:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:04.253197 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bfb4c5-d8dc-49e2-ac65-22f758ca362c None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:04.352940 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bfb4c5-d8dc-49e2-ac65-22f758ca362c None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:04.382268 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:04.388163 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5071f2-c11f-45ec-a17a-179b26c331a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:04.388763 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5071f2-c11f-45ec-a17a-179b26c331a7 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:04.389038 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5071f2-c11f-45ec-a17a-179b26c331a7 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:04.389306 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5071f2-c11f-45ec-a17a-179b26c331a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:04.390055 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5071f2-c11f-45ec-a17a-179b26c331a7 None admin] RBAC: Adding query filter params (role.id=e6933171244b410694fbc4f1d8cb0130, scope.project.id=fe7cc05cd9f44d74a635079ef883d9a9, user.id=d74675b1a7a34a95b41f7f8714d47e43) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:04.390362 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5071f2-c11f-45ec-a17a-179b26c331a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:04.391846 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5071f2-c11f-45ec-a17a-179b26c331a7 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:04.398143 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 424/840] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 00:42:04 2022] GET /identity/v3/role_assignments?user.id=d74675b1a7a34a95b41f7f8714d47e43&scope.project.id=fe7cc05cd9f44d74a635079ef883d9a9&role.id=e6933171244b410694fbc4f1d8cb0130 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:06.602636 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e61258-b6fa-4b3b-9f32-0a2eea62647d None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:06.603239 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e61258-b6fa-4b3b-9f32-0a2eea62647d None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:06.603239 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e61258-b6fa-4b3b-9f32-0a2eea62647d None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:06.604542 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 417/841] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:42:06.610256 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17df01-6927-412f-905a-17b54b9bb423 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:06.610700 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17df01-6927-412f-905a-17b54b9bb423 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:06.610809 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17df01-6927-412f-905a-17b54b9bb423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:06.629648 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-7b17df01-6927-412f-905a-17b54b9bb423 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:42:06.631022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-7b17df01-6927-412f-905a-17b54b9bb423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:42:06.699109 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 425/842] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:42:06 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:42:07.034098 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e61258-b6fa-4b3b-9f32-0a2eea62647d None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:07.149233 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e61258-b6fa-4b3b-9f32-0a2eea62647d None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:07.186875 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64015add-27d0-43f5-aaa2-8f5e9af2093a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:07.187516 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64015add-27d0-43f5-aaa2-8f5e9af2093a None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:07.187799 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64015add-27d0-43f5-aaa2-8f5e9af2093a None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:07.188077 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64015add-27d0-43f5-aaa2-8f5e9af2093a None admin] PATH_INFO: `/v3/roles/service` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:07.199373 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64015add-27d0-43f5-aaa2-8f5e9af2093a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:42:07.204115 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-64015add-27d0-43f5-aaa2-8f5e9af2093a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:42:07.204115 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:07.204115 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:42:07.204115 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:42:07.204115 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:42:07.204115 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:42:07.204115 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:42:07.204115 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:42:07.204115 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:42:07.204115 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:42:07.204115 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:42:07.204115 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:42:07.204115 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:42:07.204115 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:42:07.204115 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:42:07.204115 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:42:07.212655 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:42:07.212655 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:42:07.212655 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:42:07.212655 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:42:07.212655 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:42:07.212655 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:42:07.212655 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:42:07.212655 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:42:07.212655 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:42:07.212655 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:42:07.212655 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:42:07.212655 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:42:07.212655 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:42:07.212655 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:42:07.212655 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:42:07.212655 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:42:07.213527 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:42:07.213527 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:42:07.213527 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:42:07.213527 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:42:07.213527 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:42:07.213527 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:42:07.213527 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:42:07.213527 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:42:07.213527 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:42:07.213527 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:42:07.213527 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:42:07.213527 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:42:07.213527 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 418/843] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 00:42:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:42:07.214220 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17df01-6927-412f-905a-17b54b9bb423 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:07.320107 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17df01-6927-412f-905a-17b54b9bb423 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:07.345979 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:07.356927 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9690995-b6b6-4e09-965b-c4d78ad60b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:07.357581 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9690995-b6b6-4e09-965b-c4d78ad60b59 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:07.357865 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9690995-b6b6-4e09-965b-c4d78ad60b59 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:07.358144 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9690995-b6b6-4e09-965b-c4d78ad60b59 None admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:07.358824 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9690995-b6b6-4e09-965b-c4d78ad60b59 None admin] RBAC: Adding query filter params (name=service) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:07.359155 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9690995-b6b6-4e09-965b-c4d78ad60b59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:07.360520 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9690995-b6b6-4e09-965b-c4d78ad60b59 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:07.369652 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 426/844] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 00:42:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:07.376209 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64015add-27d0-43f5-aaa2-8f5e9af2093a None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:07.421398 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:07.484068 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64015add-27d0-43f5-aaa2-8f5e9af2093a None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:07.520342 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83998085-1b48-4d23-81d4-49c57216c45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:07.521075 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83998085-1b48-4d23-81d4-49c57216c45b None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:07.521358 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83998085-1b48-4d23-81d4-49c57216c45b None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:07.521671 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83998085-1b48-4d23-81d4-49c57216c45b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:07.533996 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83998085-1b48-4d23-81d4-49c57216c45b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:07.535482 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83998085-1b48-4d23-81d4-49c57216c45b None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:07.551167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-83998085-1b48-4d23-81d4-49c57216c45b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:42:07.551167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:07.551167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:42:07.551167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:42:07.551167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:42:07.551167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:42:07.551167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:42:07.551167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:42:07.551167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:42:07.551167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:42:07.551167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:42:07.551167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:42:07.551167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:42:07.551167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:42:07.551167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:42:07.551167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:42:07.552898 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:42:07.552898 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:42:07.552898 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:42:07.552898 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:42:07.552898 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:42:07.552898 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:42:07.552898 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:42:07.552898 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:42:07.552898 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:42:07.552898 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:42:07.552898 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:42:07.552898 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:42:07.552898 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:42:07.552898 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:42:07.552898 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:42:07.552898 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:42:07.552898 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:42:07.554146 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:42:07.554146 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:42:07.554146 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:42:07.554146 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 419/845] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:42:07.559195 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9690995-b6b6-4e09-965b-c4d78ad60b59 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:07.674717 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9690995-b6b6-4e09-965b-c4d78ad60b59 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:07.709524 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe94df-d26b-45e7-9804-49ec2826e8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:07.711285 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe94df-d26b-45e7-9804-49ec2826e8a5 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:07.711285 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe94df-d26b-45e7-9804-49ec2826e8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:07.711285 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe94df-d26b-45e7-9804-49ec2826e8a5 None admin] PATH_INFO: `/v3/domains` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:07.711285 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe94df-d26b-45e7-9804-49ec2826e8a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:07.711725 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe94df-d26b-45e7-9804-49ec2826e8a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:07.712917 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe94df-d26b-45e7-9804-49ec2826e8a5 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:07.725041 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 427/846] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:07.732025 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83998085-1b48-4d23-81d4-49c57216c45b None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:07.834773 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:07.845414 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83998085-1b48-4d23-81d4-49c57216c45b None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:07.882125 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e12786-8f1f-48f4-a739-1169f0c0f256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:07.882855 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e12786-8f1f-48f4-a739-1169f0c0f256 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:07.883301 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e12786-8f1f-48f4-a739-1169f0c0f256 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:07.883761 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e12786-8f1f-48f4-a739-1169f0c0f256 None admin] PATH_INFO: `/v3/users/placement` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:07.892618 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e12786-8f1f-48f4-a739-1169f0c0f256 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:07.894251 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e12786-8f1f-48f4-a739-1169f0c0f256 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:07.906487 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-e2e12786-8f1f-48f4-a739-1169f0c0f256 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:42:07.906487 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:07.906487 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:42:07.906487 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:42:07.906487 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:42:07.906487 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:42:07.906487 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:42:07.906487 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:42:07.906487 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:42:07.906487 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:42:07.906487 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:42:07.906487 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:42:07.906487 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:42:07.906487 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:42:07.906487 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:42:07.906487 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:42:07.907623 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:42:07.907623 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:42:07.907623 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:42:07.907623 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:42:07.907623 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:42:07.907623 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:42:07.907623 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:42:07.907623 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:42:07.907623 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:42:07.907623 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:42:07.907623 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:42:07.907623 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:42:07.907623 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:42:07.907623 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:42:07.907623 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:42:07.907623 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:42:07.907623 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:42:07.907623 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:42:07.908548 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:42:07.908548 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:42:07.908548 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:42:07.908548 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:42:07.908548 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:42:07.908548 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:42:07.908548 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:42:07.908548 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:42:07.908548 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:42:07.908548 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:42:07.908548 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 420/847] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:42:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:42:07.915138 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe94df-d26b-45e7-9804-49ec2826e8a5 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:07.969212 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:08.023590 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe94df-d26b-45e7-9804-49ec2826e8a5 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:08.060857 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e8f60-9aa1-4151-a5d5-2e57f5c140ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:08.061531 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e8f60-9aa1-4151-a5d5-2e57f5c140ac None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:08.061816 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e8f60-9aa1-4151-a5d5-2e57f5c140ac None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:08.062092 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e8f60-9aa1-4151-a5d5-2e57f5c140ac None admin] PATH_INFO: `/v3/users` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:08.062824 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5e8f60-9aa1-4151-a5d5-2e57f5c140ac None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:08.063134 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5e8f60-9aa1-4151-a5d5-2e57f5c140ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:08.064641 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5e8f60-9aa1-4151-a5d5-2e57f5c140ac None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:08.082095 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 428/848] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Aug 26 00:42:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:08.088264 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e12786-8f1f-48f4-a739-1169f0c0f256 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:08.194440 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e12786-8f1f-48f4-a739-1169f0c0f256 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:08.230756 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8506ad-9b09-450b-afa9-b634198b45cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:08.231399 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8506ad-9b09-450b-afa9-b634198b45cd None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:08.231744 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8506ad-9b09-450b-afa9-b634198b45cd None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:08.232025 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8506ad-9b09-450b-afa9-b634198b45cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:08.247651 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8506ad-9b09-450b-afa9-b634198b45cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:08.249297 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8506ad-9b09-450b-afa9-b634198b45cd None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:08.265208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-de8506ad-9b09-450b-afa9-b634198b45cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:42:08.265208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:08.265208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:42:08.265208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:42:08.265208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:42:08.265208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:42:08.265208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:42:08.265208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:42:08.265208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:42:08.265208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:42:08.265208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:42:08.265208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:42:08.265208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:42:08.265208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:42:08.265208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:42:08.265208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:42:08.267065 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:42:08.267065 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:42:08.267065 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:42:08.267065 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:42:08.267065 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:42:08.267065 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:42:08.267065 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:42:08.267065 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:42:08.267065 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:42:08.267065 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:42:08.267065 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:42:08.267065 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:42:08.267065 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:42:08.267065 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:42:08.267065 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:42:08.267065 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:42:08.267065 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:42:08.268792 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:42:08.268792 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:42:08.268792 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:42:08.268792 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 421/849] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:42:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:42:08.272846 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e8f60-9aa1-4151-a5d5-2e57f5c140ac None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:08.376846 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e8f60-9aa1-4151-a5d5-2e57f5c140ac None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:08.380619 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:08.415364 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d53618-cb5f-438f-80b6-85981973ec02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:08.415980 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d53618-cb5f-438f-80b6-85981973ec02 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:08.416316 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d53618-cb5f-438f-80b6-85981973ec02 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:08.416562 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d53618-cb5f-438f-80b6-85981973ec02 None admin] PATH_INFO: `/v3/domains` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:08.417213 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d53618-cb5f-438f-80b6-85981973ec02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:08.417551 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d53618-cb5f-438f-80b6-85981973ec02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:08.418928 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d53618-cb5f-438f-80b6-85981973ec02 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:08.431421 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 429/850] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:08.437584 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8506ad-9b09-450b-afa9-b634198b45cd None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:08.442175 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:08.541016 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8506ad-9b09-450b-afa9-b634198b45cd None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:08.576503 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5685c-5d2b-4c59-b879-8c757979e905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:08.577130 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5685c-5d2b-4c59-b879-8c757979e905 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:08.577439 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5685c-5d2b-4c59-b879-8c757979e905 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:08.577721 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5685c-5d2b-4c59-b879-8c757979e905 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:08.584284 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5685c-5d2b-4c59-b879-8c757979e905 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:08.585831 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5685c-5d2b-4c59-b879-8c757979e905 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:08.597038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-5bc5685c-5d2b-4c59-b879-8c757979e905 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:42:08.597038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:08.597038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:42:08.597038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:42:08.597038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:42:08.597038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:42:08.597038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:42:08.597038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:42:08.597038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:42:08.597038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:42:08.597038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:42:08.597038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:42:08.597038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:42:08.597038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:42:08.597038 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:42:08.598188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:42:08.598188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:42:08.598188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:42:08.598188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:42:08.598188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:42:08.598188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:42:08.598188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:42:08.598188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:42:08.598188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:42:08.598188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:42:08.598188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:42:08.598188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:42:08.598188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:42:08.598188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:42:08.598188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:42:08.598188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:42:08.598188 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:42:08.599691 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:42:08.599691 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:42:08.599691 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:42:08.599691 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:42:08.599691 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:42:08.599691 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:42:08.599691 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:42:08.599691 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:42:08.599691 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 422/851] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:42:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:42:08.605015 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d53618-cb5f-438f-80b6-85981973ec02 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:08.717100 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d53618-cb5f-438f-80b6-85981973ec02 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:08.755972 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62f8dd-eb13-44d3-9198-1c44e4aa1f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:08.756593 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62f8dd-eb13-44d3-9198-1c44e4aa1f65 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:08.756869 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62f8dd-eb13-44d3-9198-1c44e4aa1f65 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:08.757142 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62f8dd-eb13-44d3-9198-1c44e4aa1f65 None admin] PATH_INFO: `/v3/projects` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:08.757863 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62f8dd-eb13-44d3-9198-1c44e4aa1f65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:08.758175 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62f8dd-eb13-44d3-9198-1c44e4aa1f65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:08.759604 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62f8dd-eb13-44d3-9198-1c44e4aa1f65 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:08.778604 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 430/852] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 00:42:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:08.779752 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5685c-5d2b-4c59-b879-8c757979e905 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:08.859989 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:08.902461 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5685c-5d2b-4c59-b879-8c757979e905 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:08.938363 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1d4bf-b121-40ac-8e15-49c6f870bc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:08.939042 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1d4bf-b121-40ac-8e15-49c6f870bc5d None admin] REQUEST_METHOD: `PUT` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:08.939351 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1d4bf-b121-40ac-8e15-49c6f870bc5d None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:08.939638 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1d4bf-b121-40ac-8e15-49c6f870bc5d None admin] PATH_INFO: `/v3/projects/fe7cc05cd9f44d74a635079ef883d9a9/users/d74675b1a7a34a95b41f7f8714d47e43/roles/e6933171244b410694fbc4f1d8cb0130` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:08.955871 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1d4bf-b121-40ac-8e15-49c6f870bc5d None admin] RBAC: Authorizing `identity:create_grant(project_id=fe7cc05cd9f44d74a635079ef883d9a9, user_id=d74675b1a7a34a95b41f7f8714d47e43, role_id=e6933171244b410694fbc4f1d8cb0130)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:08.957950 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1d4bf-b121-40ac-8e15-49c6f870bc5d None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:09.131097 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 423/853] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 00:42:08 2022] PUT /identity/v3/projects/fe7cc05cd9f44d74a635079ef883d9a9/users/d74675b1a7a34a95b41f7f8714d47e43/roles/e6933171244b410694fbc4f1d8cb0130 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:42:11.388709 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411e419-bbf0-4ba2-aa60-f49cc5d2d217 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:11.389521 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411e419-bbf0-4ba2-aa60-f49cc5d2d217 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:11.389521 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411e419-bbf0-4ba2-aa60-f49cc5d2d217 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:11.390610 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 431/854] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:42:11.397718 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fe468-a9fa-4d9f-9f13-84f60cc73f32 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:11.398263 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fe468-a9fa-4d9f-9f13-84f60cc73f32 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:11.398383 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fe468-a9fa-4d9f-9f13-84f60cc73f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:11.417969 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-e20fe468-a9fa-4d9f-9f13-84f60cc73f32 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:42:11.419253 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-e20fe468-a9fa-4d9f-9f13-84f60cc73f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:42:11.494465 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 424/855] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:42:11 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:42:11.828452 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411e419-bbf0-4ba2-aa60-f49cc5d2d217 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:11.854990 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:11.935433 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411e419-bbf0-4ba2-aa60-f49cc5d2d217 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:11.971340 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd3f05-f256-466c-9dfb-1af5cafec8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:11.971966 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd3f05-f256-466c-9dfb-1af5cafec8b4 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:11.972253 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd3f05-f256-466c-9dfb-1af5cafec8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:11.972524 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd3f05-f256-466c-9dfb-1af5cafec8b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:11.983143 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd3f05-f256-466c-9dfb-1af5cafec8b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:42:11.987977 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-93fd3f05-f256-466c-9dfb-1af5cafec8b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:42:11.987977 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:11.987977 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:42:11.987977 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:42:11.987977 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:42:11.987977 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:42:11.987977 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:42:11.987977 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:42:11.987977 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:42:11.987977 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:42:11.987977 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:42:11.987977 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:42:11.987977 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:42:11.987977 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:42:11.987977 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:42:11.987977 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:42:11.989803 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:42:11.989803 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:42:11.989803 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:42:11.989803 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:42:11.989803 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:42:11.989803 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:42:11.989803 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:42:11.989803 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:42:11.989803 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:42:11.989803 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:42:11.989803 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:42:11.989803 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:42:11.989803 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:42:11.989803 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:42:11.989803 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:42:11.989803 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:42:11.991361 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:42:11.991361 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:42:11.991361 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:42:11.991361 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:42:11.991361 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:42:11.991361 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:42:11.991361 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:42:11.991361 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:42:11.991361 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:42:11.991361 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:42:11.991361 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:42:11.991361 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:42:11.991361 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 432/856] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 26 00:42:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:42:11.995953 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fe468-a9fa-4d9f-9f13-84f60cc73f32 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:12.043854 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:12.104088 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fe468-a9fa-4d9f-9f13-84f60cc73f32 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:12.141927 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1abeb-c392-4f36-b9c6-83e741c9614e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:12.142912 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1abeb-c392-4f36-b9c6-83e741c9614e None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:12.142912 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1abeb-c392-4f36-b9c6-83e741c9614e None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:12.143244 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1abeb-c392-4f36-b9c6-83e741c9614e None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:12.144077 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a1abeb-c392-4f36-b9c6-83e741c9614e None admin] RBAC: Adding query filter params (name=service) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:12.144331 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a1abeb-c392-4f36-b9c6-83e741c9614e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:12.148595 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a1abeb-c392-4f36-b9c6-83e741c9614e None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:12.154482 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 425/857] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 26 00:42:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:12.160565 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd3f05-f256-466c-9dfb-1af5cafec8b4 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:12.251029 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:12.268646 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd3f05-f256-466c-9dfb-1af5cafec8b4 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:12.305086 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec5a02-9faf-4bc5-b905-91ddeec84dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:12.305749 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec5a02-9faf-4bc5-b905-91ddeec84dfd None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:12.306033 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec5a02-9faf-4bc5-b905-91ddeec84dfd None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:12.306777 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec5a02-9faf-4bc5-b905-91ddeec84dfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:12.316961 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec5a02-9faf-4bc5-b905-91ddeec84dfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:12.319024 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec5a02-9faf-4bc5-b905-91ddeec84dfd None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:12.335941 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-68ec5a02-9faf-4bc5-b905-91ddeec84dfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:42:12.335941 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:12.335941 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:42:12.335941 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:42:12.335941 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:42:12.335941 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:42:12.335941 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:42:12.335941 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:42:12.335941 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:42:12.335941 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:42:12.335941 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:42:12.335941 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:42:12.335941 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:42:12.335941 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:42:12.335941 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:42:12.335941 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:42:12.337036 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:42:12.337036 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:42:12.337036 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:42:12.337036 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:42:12.337036 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:42:12.337036 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:42:12.337036 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:42:12.337036 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:42:12.337036 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:42:12.337036 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:42:12.337036 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:42:12.337036 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:42:12.337036 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:42:12.337036 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:42:12.337036 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:42:12.337036 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:42:12.337036 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:42:12.338181 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:42:12.338181 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:42:12.338181 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:42:12.338181 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 433/858] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:42:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:42:12.343515 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1abeb-c392-4f36-b9c6-83e741c9614e None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:12.455597 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1abeb-c392-4f36-b9c6-83e741c9614e None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:12.458368 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:12.492808 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e002f-4059-4a0d-9f6f-73a8e5278886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:12.493498 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e002f-4059-4a0d-9f6f-73a8e5278886 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:12.493782 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e002f-4059-4a0d-9f6f-73a8e5278886 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:12.494058 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e002f-4059-4a0d-9f6f-73a8e5278886 None admin] PATH_INFO: `/v3/domains` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:12.494711 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e002f-4059-4a0d-9f6f-73a8e5278886 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:12.495016 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e002f-4059-4a0d-9f6f-73a8e5278886 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:12.496404 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e002f-4059-4a0d-9f6f-73a8e5278886 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:12.509454 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 426/859] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:12.515316 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec5a02-9faf-4bc5-b905-91ddeec84dfd None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:12.627765 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec5a02-9faf-4bc5-b905-91ddeec84dfd None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:12.669638 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17644b3-bc31-4609-a6bc-17efc47fcf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:12.670289 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17644b3-bc31-4609-a6bc-17efc47fcf43 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:12.670555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17644b3-bc31-4609-a6bc-17efc47fcf43 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:12.670825 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17644b3-bc31-4609-a6bc-17efc47fcf43 None admin] PATH_INFO: `/v3/users/placement` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:12.674182 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:12.680484 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17644b3-bc31-4609-a6bc-17efc47fcf43 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:12.681983 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17644b3-bc31-4609-a6bc-17efc47fcf43 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:12.694779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-d17644b3-bc31-4609-a6bc-17efc47fcf43 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:42:12.694779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:12.694779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:42:12.694779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:42:12.694779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:42:12.694779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:42:12.694779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:42:12.694779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:42:12.694779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:42:12.694779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:42:12.694779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:42:12.694779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:42:12.694779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:42:12.694779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:42:12.694779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:42:12.694779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:42:12.696102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:42:12.696102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:42:12.696102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:42:12.696102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:42:12.696102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:42:12.696102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:42:12.696102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:42:12.696102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:42:12.696102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:42:12.696102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:42:12.696102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:42:12.696102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:42:12.696102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:42:12.696102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:42:12.696102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:42:12.696102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:42:12.696102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:42:12.696102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:42:12.697266 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:42:12.697266 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:42:12.697266 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:42:12.697266 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:42:12.697266 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:42:12.697266 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:42:12.697266 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:42:12.697266 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:42:12.697266 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:42:12.697266 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:42:12.697266 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 434/860] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:42:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:42:12.701228 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e002f-4059-4a0d-9f6f-73a8e5278886 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:12.822611 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e002f-4059-4a0d-9f6f-73a8e5278886 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:12.871687 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644118ad-3d69-44d6-8b3e-52024a77305f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:12.872302 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644118ad-3d69-44d6-8b3e-52024a77305f None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:12.872587 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644118ad-3d69-44d6-8b3e-52024a77305f None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:12.872869 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644118ad-3d69-44d6-8b3e-52024a77305f None admin] PATH_INFO: `/v3/users` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:12.873647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644118ad-3d69-44d6-8b3e-52024a77305f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:12.873958 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644118ad-3d69-44d6-8b3e-52024a77305f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:12.875413 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644118ad-3d69-44d6-8b3e-52024a77305f None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:12.893903 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 427/861] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Aug 26 00:42:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:12.900733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17644b3-bc31-4609-a6bc-17efc47fcf43 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:13.005598 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17644b3-bc31-4609-a6bc-17efc47fcf43 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:13.048005 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078a670-272b-47bf-9608-e143d6569e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:13.048668 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078a670-272b-47bf-9608-e143d6569e66 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:13.048944 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078a670-272b-47bf-9608-e143d6569e66 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:13.049216 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078a670-272b-47bf-9608-e143d6569e66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:13.126513 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:13.134561 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1078a670-272b-47bf-9608-e143d6569e66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:13.136128 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1078a670-272b-47bf-9608-e143d6569e66 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:13.241454 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 435/862] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:42:12 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:42:13.247687 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644118ad-3d69-44d6-8b3e-52024a77305f None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:13.273430 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:13.357577 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644118ad-3d69-44d6-8b3e-52024a77305f None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:13.395077 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78335acf-2862-4e2d-ae2f-36bbf0e14d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:13.395808 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78335acf-2862-4e2d-ae2f-36bbf0e14d83 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:13.396191 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78335acf-2862-4e2d-ae2f-36bbf0e14d83 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:13.396468 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78335acf-2862-4e2d-ae2f-36bbf0e14d83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:13.407432 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78335acf-2862-4e2d-ae2f-36bbf0e14d83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:13.408936 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78335acf-2862-4e2d-ae2f-36bbf0e14d83 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:13.425334 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-78335acf-2862-4e2d-ae2f-36bbf0e14d83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:42:13.425334 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:13.425334 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:42:13.425334 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:42:13.425334 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:42:13.425334 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:42:13.425334 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:42:13.425334 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:42:13.425334 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:42:13.425334 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:42:13.425334 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:42:13.425334 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:42:13.425334 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:42:13.425334 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:42:13.425334 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:42:13.425334 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:42:13.426645 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:42:13.426645 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:42:13.426645 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:42:13.426645 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:42:13.426645 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:42:13.426645 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:42:13.426645 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:42:13.426645 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:42:13.426645 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:42:13.426645 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:42:13.426645 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:42:13.426645 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:42:13.426645 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:42:13.426645 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:42:13.426645 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:42:13.426645 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:42:13.426645 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:42:13.428104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:42:13.428104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:42:13.428104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:42:13.428104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 428/863] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:42:13.433509 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078a670-272b-47bf-9608-e143d6569e66 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:13.534669 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:13.541722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078a670-272b-47bf-9608-e143d6569e66 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:13.580607 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10ca23-b3ba-4dbe-8214-f520739f8ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:13.581316 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10ca23-b3ba-4dbe-8214-f520739f8ce2 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:13.581634 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10ca23-b3ba-4dbe-8214-f520739f8ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:13.581902 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10ca23-b3ba-4dbe-8214-f520739f8ce2 None admin] PATH_INFO: `/v3/domains` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:13.582594 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10ca23-b3ba-4dbe-8214-f520739f8ce2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:13.583431 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10ca23-b3ba-4dbe-8214-f520739f8ce2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:13.584986 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10ca23-b3ba-4dbe-8214-f520739f8ce2 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:13.596861 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 436/864] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:42:13.603682 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78335acf-2862-4e2d-ae2f-36bbf0e14d83 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:13.688735 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:13.716406 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78335acf-2862-4e2d-ae2f-36bbf0e14d83 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:13.757193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4edc6b-7e98-465f-b3d8-7ef487c00669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:13.757875 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4edc6b-7e98-465f-b3d8-7ef487c00669 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:13.758152 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4edc6b-7e98-465f-b3d8-7ef487c00669 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:13.758433 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4edc6b-7e98-465f-b3d8-7ef487c00669 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:13.765967 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4edc6b-7e98-465f-b3d8-7ef487c00669 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:13.767445 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4edc6b-7e98-465f-b3d8-7ef487c00669 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:13.780806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-9f4edc6b-7e98-465f-b3d8-7ef487c00669 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:42:13.780806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:13.780806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:42:13.780806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:42:13.780806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:42:13.780806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:42:13.780806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:42:13.780806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:42:13.780806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:42:13.780806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:42:13.780806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:42:13.780806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:42:13.780806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:42:13.780806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:42:13.780806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:42:13.782975 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:42:13.782975 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:42:13.782975 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:42:13.782975 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:42:13.782975 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:42:13.782975 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:42:13.782975 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:42:13.782975 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:42:13.782975 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:42:13.782975 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:42:13.782975 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:42:13.782975 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:42:13.782975 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:42:13.782975 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:42:13.782975 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:42:13.782975 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:42:13.782975 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:42:13.784068 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:42:13.784068 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:42:13.784068 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:42:13.784068 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:42:13.784068 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:42:13.784068 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:42:13.784068 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:42:13.784068 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:42:13.784068 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 429/865] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:42:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:42:13.789148 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10ca23-b3ba-4dbe-8214-f520739f8ce2 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:13.910301 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10ca23-b3ba-4dbe-8214-f520739f8ce2 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:13.949777 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8d2f3-6abc-476c-a56c-da6a1e0b5871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:13.950396 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8d2f3-6abc-476c-a56c-da6a1e0b5871 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:13.950739 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8d2f3-6abc-476c-a56c-da6a1e0b5871 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:13.951016 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8d2f3-6abc-476c-a56c-da6a1e0b5871 None admin] PATH_INFO: `/v3/projects` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:13.951761 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8d2f3-6abc-476c-a56c-da6a1e0b5871 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:13.952073 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8d2f3-6abc-476c-a56c-da6a1e0b5871 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:13.953553 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8d2f3-6abc-476c-a56c-da6a1e0b5871 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:13.966900 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 437/866] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 00:42:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:13.973618 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4edc6b-7e98-465f-b3d8-7ef487c00669 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:14.086428 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4edc6b-7e98-465f-b3d8-7ef487c00669 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:14.133832 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2ceb4-60ea-4498-9d5e-129e24fb6a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:14.134468 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2ceb4-60ea-4498-9d5e-129e24fb6a27 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:14.134757 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2ceb4-60ea-4498-9d5e-129e24fb6a27 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:14.135037 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2ceb4-60ea-4498-9d5e-129e24fb6a27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:14.135766 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2ceb4-60ea-4498-9d5e-129e24fb6a27 None admin] RBAC: Adding query filter params (role.id=e6933171244b410694fbc4f1d8cb0130, scope.project.id=fe7cc05cd9f44d74a635079ef883d9a9, user.id=d74675b1a7a34a95b41f7f8714d47e43) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:14.136079 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2ceb4-60ea-4498-9d5e-129e24fb6a27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:14.137585 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2ceb4-60ea-4498-9d5e-129e24fb6a27 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:14.139519 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:14.144057 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 430/867] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 00:42:13 2022] GET /identity/v3/role_assignments?user.id=d74675b1a7a34a95b41f7f8714d47e43&scope.project.id=fe7cc05cd9f44d74a635079ef883d9a9&role.id=e6933171244b410694fbc4f1d8cb0130 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:16.444739 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8678176-5183-4e22-b700-af6f2ea89ef1 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:16.445341 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8678176-5183-4e22-b700-af6f2ea89ef1 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:16.445341 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8678176-5183-4e22-b700-af6f2ea89ef1 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:16.446733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 438/868] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:42:16.452052 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b93db-2ff1-4b1a-880d-2bec701083ed None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:16.452500 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b93db-2ff1-4b1a-880d-2bec701083ed None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:16.452611 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b93db-2ff1-4b1a-880d-2bec701083ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:16.472068 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-b34b93db-2ff1-4b1a-880d-2bec701083ed None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:42:16.473268 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-b34b93db-2ff1-4b1a-880d-2bec701083ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:42:16.541985 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 431/869] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:42:16 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:42:16.875511 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8678176-5183-4e22-b700-af6f2ea89ef1 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:16.896387 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:17.029612 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8678176-5183-4e22-b700-af6f2ea89ef1 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:17.064195 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d23c4-273c-4b2f-a6f0-943beb22b1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:17.064823 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d23c4-273c-4b2f-a6f0-943beb22b1fe None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:17.065105 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d23c4-273c-4b2f-a6f0-943beb22b1fe None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:17.065406 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d23c4-273c-4b2f-a6f0-943beb22b1fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:17.076252 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d23c4-273c-4b2f-a6f0-943beb22b1fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:42:17.081044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-a33d23c4-273c-4b2f-a6f0-943beb22b1fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:42:17.081044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:17.081044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:42:17.081044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:42:17.081044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:42:17.081044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:42:17.081044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:42:17.081044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:42:17.081044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:42:17.081044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:42:17.081044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:42:17.081044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:42:17.081044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:42:17.081044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:42:17.081044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:42:17.081044 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:42:17.082266 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:42:17.082266 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:42:17.082266 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:42:17.082266 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:42:17.082266 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:42:17.082266 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:42:17.082266 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:42:17.082266 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:42:17.082266 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:42:17.082266 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:42:17.082266 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:42:17.082266 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:42:17.082266 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:42:17.082266 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:42:17.082266 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:42:17.082266 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:42:17.083758 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:42:17.083758 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:42:17.083758 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:42:17.083758 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:42:17.083758 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:42:17.083758 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:42:17.083758 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:42:17.083758 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:42:17.083758 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:42:17.083758 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:42:17.083758 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:42:17.083758 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:42:17.083758 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 439/870] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 00:42:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:42:17.089473 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b93db-2ff1-4b1a-880d-2bec701083ed None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:17.191182 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b93db-2ff1-4b1a-880d-2bec701083ed None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:17.219494 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:17.227706 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4487a8b-9abd-4751-839c-ef5a9a8fcb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:17.228311 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4487a8b-9abd-4751-839c-ef5a9a8fcb0a None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:17.228590 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4487a8b-9abd-4751-839c-ef5a9a8fcb0a None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:17.228861 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4487a8b-9abd-4751-839c-ef5a9a8fcb0a None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:17.229559 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4487a8b-9abd-4751-839c-ef5a9a8fcb0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:17.229863 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4487a8b-9abd-4751-839c-ef5a9a8fcb0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:17.231258 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4487a8b-9abd-4751-839c-ef5a9a8fcb0a None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:17.241441 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 432/871] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:42:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:17.246961 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d23c4-273c-4b2f-a6f0-943beb22b1fe None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:17.331571 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:17.355959 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d23c4-273c-4b2f-a6f0-943beb22b1fe None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:17.394283 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccae14-2b85-4555-ba07-08399a43dc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:17.394930 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccae14-2b85-4555-ba07-08399a43dc7a None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:17.395216 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccae14-2b85-4555-ba07-08399a43dc7a None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:17.395509 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccae14-2b85-4555-ba07-08399a43dc7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:17.406796 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ccae14-2b85-4555-ba07-08399a43dc7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:17.408350 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ccae14-2b85-4555-ba07-08399a43dc7a None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:17.425274 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-30ccae14-2b85-4555-ba07-08399a43dc7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:42:17.425274 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:17.425274 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:42:17.425274 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:42:17.425274 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:42:17.425274 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:42:17.425274 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:42:17.425274 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:42:17.425274 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:42:17.425274 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:42:17.425274 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:42:17.425274 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:42:17.425274 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:42:17.425274 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:42:17.425274 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:42:17.425274 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:42:17.428728 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:42:17.428728 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:42:17.428728 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:42:17.428728 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:42:17.428728 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:42:17.428728 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:42:17.428728 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:42:17.428728 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:42:17.428728 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:42:17.428728 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:42:17.428728 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:42:17.428728 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:42:17.428728 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:42:17.428728 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:42:17.428728 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:42:17.428728 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:42:17.428728 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:42:17.429852 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:42:17.429852 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:42:17.429852 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:42:17.429852 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 440/872] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:42:17.433074 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4487a8b-9abd-4751-839c-ef5a9a8fcb0a None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:17.539555 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4487a8b-9abd-4751-839c-ef5a9a8fcb0a None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:17.576538 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4678494-5a8f-4206-9937-7809bccec3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:17.577145 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4678494-5a8f-4206-9937-7809bccec3ad None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:17.577459 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4678494-5a8f-4206-9937-7809bccec3ad None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:17.577765 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4678494-5a8f-4206-9937-7809bccec3ad None admin] PATH_INFO: `/v3/domains` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:17.578412 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4678494-5a8f-4206-9937-7809bccec3ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:17.578721 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4678494-5a8f-4206-9937-7809bccec3ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:17.580194 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4678494-5a8f-4206-9937-7809bccec3ad None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:17.592185 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 433/873] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:17.598199 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccae14-2b85-4555-ba07-08399a43dc7a None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:17.700656 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccae14-2b85-4555-ba07-08399a43dc7a None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:17.727666 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:17.735447 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb6ff8-7ca6-4557-ace0-7f5fd0be8302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:17.736080 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb6ff8-7ca6-4557-ace0-7f5fd0be8302 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:17.736417 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb6ff8-7ca6-4557-ace0-7f5fd0be8302 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:17.736644 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb6ff8-7ca6-4557-ace0-7f5fd0be8302 None admin] PATH_INFO: `/v3/users/placement` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:17.744944 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb6ff8-7ca6-4557-ace0-7f5fd0be8302 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:17.746422 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb6ff8-7ca6-4557-ace0-7f5fd0be8302 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:17.757673 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-16eb6ff8-7ca6-4557-ace0-7f5fd0be8302 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:42:17.757673 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:17.757673 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:42:17.757673 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:42:17.757673 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:42:17.757673 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:42:17.757673 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:42:17.757673 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:42:17.757673 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:42:17.757673 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:42:17.757673 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:42:17.757673 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:42:17.757673 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:42:17.757673 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:42:17.757673 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:42:17.757673 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:42:17.758868 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:42:17.758868 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:42:17.758868 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:42:17.758868 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:42:17.758868 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:42:17.758868 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:42:17.758868 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:42:17.758868 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:42:17.758868 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:42:17.758868 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:42:17.758868 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:42:17.758868 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:42:17.758868 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:42:17.758868 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:42:17.758868 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:42:17.758868 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:42:17.758868 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:42:17.758868 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:42:17.760032 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:42:17.760032 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:42:17.760032 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:42:17.760032 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:42:17.760032 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:42:17.760032 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:42:17.760032 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:42:17.760032 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:42:17.760032 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:42:17.760032 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:42:17.760032 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 441/874] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:42:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:42:17.764748 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4678494-5a8f-4206-9937-7809bccec3ad None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:17.817765 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:17.867721 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4678494-5a8f-4206-9937-7809bccec3ad None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:17.902140 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3054f2-131a-4f69-9877-532769b768cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:17.902752 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3054f2-131a-4f69-9877-532769b768cb None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:17.903035 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3054f2-131a-4f69-9877-532769b768cb None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:17.903309 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3054f2-131a-4f69-9877-532769b768cb None admin] PATH_INFO: `/v3/users` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:17.904044 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3054f2-131a-4f69-9877-532769b768cb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:17.904352 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3054f2-131a-4f69-9877-532769b768cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:17.905832 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3054f2-131a-4f69-9877-532769b768cb None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:17.923841 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 434/875] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Aug 26 00:42:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:17.929745 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb6ff8-7ca6-4557-ace0-7f5fd0be8302 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:18.034447 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb6ff8-7ca6-4557-ace0-7f5fd0be8302 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:18.077941 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ffb8d-7e32-4682-85a2-a0413b708409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:18.077941 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ffb8d-7e32-4682-85a2-a0413b708409 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:18.077941 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ffb8d-7e32-4682-85a2-a0413b708409 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:18.077941 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ffb8d-7e32-4682-85a2-a0413b708409 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:18.126066 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:18.138919 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ffb8d-7e32-4682-85a2-a0413b708409 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:18.140539 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ffb8d-7e32-4682-85a2-a0413b708409 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:18.248041 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 442/876] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:42:17 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:42:18.253871 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3054f2-131a-4f69-9877-532769b768cb None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:18.354306 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3054f2-131a-4f69-9877-532769b768cb None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:18.364834 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:18.389839 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0a16d-dc86-4d42-a166-7ef5ad0da075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:18.390475 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0a16d-dc86-4d42-a166-7ef5ad0da075 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:18.390753 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0a16d-dc86-4d42-a166-7ef5ad0da075 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:18.391022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0a16d-dc86-4d42-a166-7ef5ad0da075 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:18.400842 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0a16d-dc86-4d42-a166-7ef5ad0da075 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:18.402336 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0a16d-dc86-4d42-a166-7ef5ad0da075 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:18.417356 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-53e0a16d-dc86-4d42-a166-7ef5ad0da075 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:42:18.417356 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:18.417356 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:42:18.417356 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:42:18.417356 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:42:18.417356 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:42:18.417356 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:42:18.417356 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:42:18.417356 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:42:18.417356 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:42:18.417356 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:42:18.417356 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:42:18.417356 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:42:18.417356 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:42:18.417356 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:42:18.417356 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:42:18.424123 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:42:18.424123 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:42:18.424123 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:42:18.424123 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:42:18.424123 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:42:18.424123 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:42:18.424123 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:42:18.424123 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:42:18.424123 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:42:18.424123 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:42:18.424123 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:42:18.424123 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:42:18.424123 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:42:18.424123 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:42:18.424123 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:42:18.424123 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:42:18.424123 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:42:18.425251 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:42:18.425251 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:42:18.425251 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:42:18.425251 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 435/877] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:42:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:42:18.425521 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ffb8d-7e32-4682-85a2-a0413b708409 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:18.518856 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:18.530985 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ffb8d-7e32-4682-85a2-a0413b708409 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:18.569403 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467d57a-05ce-4de9-b51a-4cdec7c50667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:18.570029 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467d57a-05ce-4de9-b51a-4cdec7c50667 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:18.570343 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467d57a-05ce-4de9-b51a-4cdec7c50667 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:18.570620 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467d57a-05ce-4de9-b51a-4cdec7c50667 None admin] PATH_INFO: `/v3/domains` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:18.571276 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467d57a-05ce-4de9-b51a-4cdec7c50667 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:18.571585 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467d57a-05ce-4de9-b51a-4cdec7c50667 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:18.572968 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467d57a-05ce-4de9-b51a-4cdec7c50667 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:18.585300 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 443/878] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:42:18.591219 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0a16d-dc86-4d42-a166-7ef5ad0da075 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:18.697200 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0a16d-dc86-4d42-a166-7ef5ad0da075 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:18.732642 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9ba3f-d82d-4551-ad1a-3c8103add844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:18.733281 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9ba3f-d82d-4551-ad1a-3c8103add844 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:18.733661 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9ba3f-d82d-4551-ad1a-3c8103add844 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:18.733925 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9ba3f-d82d-4551-ad1a-3c8103add844 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:18.741208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9ba3f-d82d-4551-ad1a-3c8103add844 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:18.742701 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9ba3f-d82d-4551-ad1a-3c8103add844 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:18.754893 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-49e9ba3f-d82d-4551-ad1a-3c8103add844 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:42:18.754893 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:18.754893 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:42:18.754893 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:42:18.754893 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:42:18.754893 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:42:18.754893 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:42:18.754893 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:42:18.754893 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:42:18.754893 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:42:18.754893 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:42:18.754893 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:42:18.754893 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:42:18.754893 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:42:18.754893 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:42:18.756228 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:42:18.756228 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:42:18.756228 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:42:18.756228 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:42:18.756228 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:42:18.756228 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:42:18.756228 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:42:18.756228 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:42:18.756228 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:42:18.756228 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:42:18.756228 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:42:18.756228 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:42:18.756228 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:42:18.756228 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:42:18.756228 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:42:18.756228 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:42:18.756228 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:42:18.757398 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:42:18.757398 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:42:18.757398 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:42:18.757398 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:42:18.757398 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:42:18.757398 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:42:18.757398 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:42:18.757398 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:42:18.757398 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 436/879] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:42:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:42:18.762182 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467d57a-05ce-4de9-b51a-4cdec7c50667 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:18.874009 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467d57a-05ce-4de9-b51a-4cdec7c50667 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:18.913723 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b6822-864a-4899-a1cb-36493c52fc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:18.914784 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b6822-864a-4899-a1cb-36493c52fc03 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:18.915293 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b6822-864a-4899-a1cb-36493c52fc03 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:18.915798 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b6822-864a-4899-a1cb-36493c52fc03 None admin] PATH_INFO: `/v3/projects` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:18.917171 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b6822-864a-4899-a1cb-36493c52fc03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:18.917757 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b6822-864a-4899-a1cb-36493c52fc03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:18.920506 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b6822-864a-4899-a1cb-36493c52fc03 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:18.945005 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 444/880] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 00:42:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:18.951238 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9ba3f-d82d-4551-ad1a-3c8103add844 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:18.976720 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:19.070408 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9ba3f-d82d-4551-ad1a-3c8103add844 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:19.107383 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38dd38c-0bcf-4621-b760-ad9bebad1a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:19.107997 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38dd38c-0bcf-4621-b760-ad9bebad1a4d None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:19.108281 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38dd38c-0bcf-4621-b760-ad9bebad1a4d None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:19.108562 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38dd38c-0bcf-4621-b760-ad9bebad1a4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:19.109292 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38dd38c-0bcf-4621-b760-ad9bebad1a4d None admin] RBAC: Adding query filter params (role.id=f13055bcebf847bf8b46160ded13810b, scope.project.id=fe7cc05cd9f44d74a635079ef883d9a9, user.id=d74675b1a7a34a95b41f7f8714d47e43) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:19.109635 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38dd38c-0bcf-4621-b760-ad9bebad1a4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:19.111113 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38dd38c-0bcf-4621-b760-ad9bebad1a4d None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:19.117263 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 437/881] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 00:42:18 2022] GET /identity/v3/role_assignments?user.id=d74675b1a7a34a95b41f7f8714d47e43&scope.project.id=fe7cc05cd9f44d74a635079ef883d9a9&role.id=f13055bcebf847bf8b46160ded13810b => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:21.330964 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acb469-34e7-4873-903b-ed38c92387bb None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:21.331464 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acb469-34e7-4873-903b-ed38c92387bb None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:21.331464 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acb469-34e7-4873-903b-ed38c92387bb None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:21.333545 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 445/882] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:42:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:42:21.338834 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cf140-c56e-47ee-b768-2ff667dde8c5 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:21.339271 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cf140-c56e-47ee-b768-2ff667dde8c5 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:21.339409 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cf140-c56e-47ee-b768-2ff667dde8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:21.357747 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-c18cf140-c56e-47ee-b768-2ff667dde8c5 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:42:21.358965 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-c18cf140-c56e-47ee-b768-2ff667dde8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:42:21.436812 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 438/883] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:42:21 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:42:21.763004 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09acb469-34e7-4873-903b-ed38c92387bb None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:21.774890 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:21.871336 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09acb469-34e7-4873-903b-ed38c92387bb None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:21.905384 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00511d6e-b26c-4a60-9b30-3f9f1a230aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:21.906025 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00511d6e-b26c-4a60-9b30-3f9f1a230aec None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:21.906304 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00511d6e-b26c-4a60-9b30-3f9f1a230aec None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:21.906575 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00511d6e-b26c-4a60-9b30-3f9f1a230aec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:21.918158 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00511d6e-b26c-4a60-9b30-3f9f1a230aec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:42:21.923244 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-00511d6e-b26c-4a60-9b30-3f9f1a230aec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:42:21.923244 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:21.923244 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:42:21.923244 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:42:21.923244 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:42:21.923244 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:42:21.923244 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:42:21.923244 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:42:21.923244 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:42:21.923244 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:42:21.923244 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:42:21.923244 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:42:21.923244 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:42:21.923244 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:42:21.923244 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:42:21.923244 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:42:21.931459 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:42:21.931459 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:42:21.931459 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:42:21.931459 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:42:21.931459 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:42:21.931459 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:42:21.931459 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:42:21.931459 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:42:21.931459 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:42:21.931459 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:42:21.931459 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:42:21.931459 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:42:21.931459 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:42:21.931459 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:42:21.931459 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:42:21.931459 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:42:21.932528 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:42:21.932528 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:42:21.932528 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:42:21.932528 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:42:21.932528 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:42:21.932528 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:42:21.932528 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:42:21.932528 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:42:21.932528 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:42:21.932528 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:42:21.932528 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:42:21.932528 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:42:21.932528 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 446/884] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 00:42:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:42:21.933408 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cf140-c56e-47ee-b768-2ff667dde8c5 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:21.948037 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:22.039897 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cf140-c56e-47ee-b768-2ff667dde8c5 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:22.076269 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42efafdf-317e-4ebc-85d3-b90adfddf45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:22.076854 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efafdf-317e-4ebc-85d3-b90adfddf45a None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:22.077139 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efafdf-317e-4ebc-85d3-b90adfddf45a None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:22.077433 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efafdf-317e-4ebc-85d3-b90adfddf45a None admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:22.078099 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42efafdf-317e-4ebc-85d3-b90adfddf45a None admin] RBAC: Adding query filter params (name=admin) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:22.078399 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42efafdf-317e-4ebc-85d3-b90adfddf45a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:22.079823 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42efafdf-317e-4ebc-85d3-b90adfddf45a None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:22.089314 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 439/885] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:42:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:22.095867 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00511d6e-b26c-4a60-9b30-3f9f1a230aec None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:22.170898 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:22.205802 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00511d6e-b26c-4a60-9b30-3f9f1a230aec None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:22.242514 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a108ad-8191-4ffc-9e16-56988f3adf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:22.243151 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a108ad-8191-4ffc-9e16-56988f3adf13 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:22.243431 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a108ad-8191-4ffc-9e16-56988f3adf13 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:22.243703 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a108ad-8191-4ffc-9e16-56988f3adf13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:22.254336 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a108ad-8191-4ffc-9e16-56988f3adf13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:22.256564 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a108ad-8191-4ffc-9e16-56988f3adf13 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:22.272131 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-56a108ad-8191-4ffc-9e16-56988f3adf13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:42:22.272131 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:22.272131 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:42:22.272131 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:42:22.272131 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:42:22.272131 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:42:22.272131 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:42:22.272131 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:42:22.272131 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:42:22.272131 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:42:22.272131 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:42:22.272131 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:42:22.272131 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:42:22.272131 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:42:22.272131 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:42:22.272131 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:42:22.273253 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:42:22.273253 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:42:22.273253 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:42:22.273253 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:42:22.273253 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:42:22.273253 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:42:22.273253 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:42:22.273253 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:42:22.273253 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:42:22.273253 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:42:22.273253 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:42:22.273253 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:42:22.273253 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:42:22.273253 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:42:22.273253 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:42:22.273253 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:42:22.273253 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:42:22.274430 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:42:22.274430 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:42:22.274430 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:42:22.274430 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 447/886] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:42:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:42:22.279478 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42efafdf-317e-4ebc-85d3-b90adfddf45a None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:22.364550 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:22.388348 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42efafdf-317e-4ebc-85d3-b90adfddf45a None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:22.422579 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2a1bf-74ab-4cb6-b18d-43504c59ecc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:22.423199 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2a1bf-74ab-4cb6-b18d-43504c59ecc8 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:22.423479 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2a1bf-74ab-4cb6-b18d-43504c59ecc8 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:22.423775 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2a1bf-74ab-4cb6-b18d-43504c59ecc8 None admin] PATH_INFO: `/v3/domains` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:22.424406 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2a1bf-74ab-4cb6-b18d-43504c59ecc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:22.424709 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2a1bf-74ab-4cb6-b18d-43504c59ecc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:22.426120 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2a1bf-74ab-4cb6-b18d-43504c59ecc8 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:22.439088 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 440/887] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:22.446929 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a108ad-8191-4ffc-9e16-56988f3adf13 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:22.552097 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a108ad-8191-4ffc-9e16-56988f3adf13 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:22.575918 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:22.591424 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d9f09-c511-46ca-b41e-f7b6727665bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:22.592065 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d9f09-c511-46ca-b41e-f7b6727665bf None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:22.592358 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d9f09-c511-46ca-b41e-f7b6727665bf None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:22.592630 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d9f09-c511-46ca-b41e-f7b6727665bf None admin] PATH_INFO: `/v3/users/placement` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:22.600551 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d9f09-c511-46ca-b41e-f7b6727665bf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:22.602083 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d9f09-c511-46ca-b41e-f7b6727665bf None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:22.613290 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-2a4d9f09-c511-46ca-b41e-f7b6727665bf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:42:22.613290 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:22.613290 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:42:22.613290 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:42:22.613290 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:42:22.613290 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:42:22.613290 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:42:22.613290 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:42:22.613290 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:42:22.613290 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:42:22.613290 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:42:22.613290 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:42:22.613290 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:42:22.613290 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:42:22.613290 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:42:22.613290 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:42:22.615112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:42:22.615112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:42:22.615112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:42:22.615112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:42:22.615112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:42:22.615112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:42:22.615112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:42:22.615112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:42:22.615112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:42:22.615112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:42:22.615112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:42:22.615112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:42:22.615112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:42:22.615112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:42:22.615112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:42:22.615112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:42:22.615112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:42:22.615112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:42:22.616361 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:42:22.616361 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:42:22.616361 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:42:22.616361 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:42:22.616361 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:42:22.616361 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:42:22.616361 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:42:22.616361 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:42:22.616361 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:42:22.616361 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:42:22.616361 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 448/888] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:42:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:42:22.621045 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2a1bf-74ab-4cb6-b18d-43504c59ecc8 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:22.731683 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2a1bf-74ab-4cb6-b18d-43504c59ecc8 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:22.766886 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bf8b0-1370-4486-ab2c-ff9c5a236580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:22.767512 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bf8b0-1370-4486-ab2c-ff9c5a236580 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:22.767798 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bf8b0-1370-4486-ab2c-ff9c5a236580 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:22.768075 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bf8b0-1370-4486-ab2c-ff9c5a236580 None admin] PATH_INFO: `/v3/users` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:22.768813 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55bf8b0-1370-4486-ab2c-ff9c5a236580 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:22.769123 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55bf8b0-1370-4486-ab2c-ff9c5a236580 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:22.771281 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55bf8b0-1370-4486-ab2c-ff9c5a236580 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:22.774164 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:22.789214 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 441/889] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Aug 26 00:42:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:22.795830 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d9f09-c511-46ca-b41e-f7b6727665bf None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:22.901723 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d9f09-c511-46ca-b41e-f7b6727665bf None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:22.938379 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1dee6-de51-4c84-9b9f-761f656e7815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:22.939018 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1dee6-de51-4c84-9b9f-761f656e7815 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:22.939333 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1dee6-de51-4c84-9b9f-761f656e7815 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:22.939578 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1dee6-de51-4c84-9b9f-761f656e7815 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:22.951700 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c1dee6-de51-4c84-9b9f-761f656e7815 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:22.955644 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c1dee6-de51-4c84-9b9f-761f656e7815 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:22.967455 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-29c1dee6-de51-4c84-9b9f-761f656e7815 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:42:22.967455 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:22.967455 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:42:22.967455 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:42:22.967455 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:42:22.967455 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:42:22.967455 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:42:22.967455 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:42:22.967455 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:42:22.967455 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:42:22.967455 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:42:22.967455 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:42:22.967455 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:42:22.967455 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:42:22.967455 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:42:22.967455 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:42:22.968412 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:42:22.968412 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:42:22.968412 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:42:22.968412 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:42:22.968412 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:42:22.968412 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:42:22.968412 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:42:22.968412 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:42:22.968412 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:42:22.968412 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:42:22.968412 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:42:22.968412 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:42:22.968412 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:42:22.968412 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:42:22.968412 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:42:22.968412 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:42:22.968412 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:42:22.969412 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:42:22.969412 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:42:22.969412 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:42:22.969412 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 449/890] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:42:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:42:22.974679 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bf8b0-1370-4486-ab2c-ff9c5a236580 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:23.081798 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bf8b0-1370-4486-ab2c-ff9c5a236580 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:23.116727 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf36d9-ada2-48ba-95d8-f3aef371c738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:23.117337 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf36d9-ada2-48ba-95d8-f3aef371c738 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:23.117654 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf36d9-ada2-48ba-95d8-f3aef371c738 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:23.117932 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf36d9-ada2-48ba-95d8-f3aef371c738 None admin] PATH_INFO: `/v3/domains` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:23.118588 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf36d9-ada2-48ba-95d8-f3aef371c738 None admin] RBAC: Adding query filter params (name=Default) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:23.118899 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf36d9-ada2-48ba-95d8-f3aef371c738 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:23.120277 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf36d9-ada2-48ba-95d8-f3aef371c738 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:23.132215 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 442/891] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:23.138152 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1dee6-de51-4c84-9b9f-761f656e7815 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:23.170157 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:23.243228 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1dee6-de51-4c84-9b9f-761f656e7815 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:23.280037 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a91382-7d48-440a-a0fc-c4fffffbbfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:23.280747 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a91382-7d48-440a-a0fc-c4fffffbbfc9 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:23.281126 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a91382-7d48-440a-a0fc-c4fffffbbfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:23.281522 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a91382-7d48-440a-a0fc-c4fffffbbfc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:23.289800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a91382-7d48-440a-a0fc-c4fffffbbfc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:23.291246 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a91382-7d48-440a-a0fc-c4fffffbbfc9 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:23.304169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-43a91382-7d48-440a-a0fc-c4fffffbbfc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:42:23.304169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:23.304169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:42:23.304169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:42:23.304169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:42:23.304169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:42:23.304169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:42:23.304169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:42:23.304169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:42:23.304169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:42:23.304169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:42:23.304169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:42:23.304169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:42:23.304169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:42:23.304169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:42:23.307679 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:42:23.307679 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:42:23.307679 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:42:23.307679 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:42:23.307679 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:42:23.307679 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:42:23.307679 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:42:23.307679 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:42:23.307679 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:42:23.307679 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:42:23.307679 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:42:23.307679 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:42:23.307679 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:42:23.307679 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:42:23.307679 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:42:23.307679 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:42:23.307679 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:42:23.308749 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:42:23.308749 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:42:23.308749 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:42:23.308749 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:42:23.308749 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:42:23.308749 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:42:23.308749 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:42:23.308749 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:42:23.308749 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 450/892] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:42:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:42:23.311319 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf36d9-ada2-48ba-95d8-f3aef371c738 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:23.371109 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:23.415894 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf36d9-ada2-48ba-95d8-f3aef371c738 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:23.450940 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca45000-6ffb-4861-bf58-a5743bac3579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:23.451476 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca45000-6ffb-4861-bf58-a5743bac3579 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:23.451758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca45000-6ffb-4861-bf58-a5743bac3579 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:23.452033 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca45000-6ffb-4861-bf58-a5743bac3579 None admin] PATH_INFO: `/v3/projects` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:23.452731 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca45000-6ffb-4861-bf58-a5743bac3579 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:23.453046 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca45000-6ffb-4861-bf58-a5743bac3579 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:23.454680 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca45000-6ffb-4861-bf58-a5743bac3579 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:23.466804 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 443/893] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 00:42:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:23.473856 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a91382-7d48-440a-a0fc-c4fffffbbfc9 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:23.572206 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:23.580744 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a91382-7d48-440a-a0fc-c4fffffbbfc9 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:23.615661 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f2175-a0cb-4e9c-a261-5b94a31a3500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:23.616314 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f2175-a0cb-4e9c-a261-5b94a31a3500 None admin] REQUEST_METHOD: `PUT` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:23.616595 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f2175-a0cb-4e9c-a261-5b94a31a3500 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:23.616868 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f2175-a0cb-4e9c-a261-5b94a31a3500 None admin] PATH_INFO: `/v3/projects/fe7cc05cd9f44d74a635079ef883d9a9/users/d74675b1a7a34a95b41f7f8714d47e43/roles/f13055bcebf847bf8b46160ded13810b` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:23.618807 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f2175-a0cb-4e9c-a261-5b94a31a3500 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe7cc05cd9f44d74a635079ef883d9a9, user_id=d74675b1a7a34a95b41f7f8714d47e43, role_id=f13055bcebf847bf8b46160ded13810b)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:23.620322 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f2175-a0cb-4e9c-a261-5b94a31a3500 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:23.764062 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 451/894] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 26 00:42:23 2022] PUT /identity/v3/projects/fe7cc05cd9f44d74a635079ef883d9a9/users/d74675b1a7a34a95b41f7f8714d47e43/roles/f13055bcebf847bf8b46160ded13810b => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:42:26.002243 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5445632-dff8-45ee-ac64-4abc6f16deba None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:26.002812 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5445632-dff8-45ee-ac64-4abc6f16deba None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:26.002812 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5445632-dff8-45ee-ac64-4abc6f16deba None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:26.004148 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 444/895] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:42:26.010685 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fe31c-86fc-4d86-81b0-d97f51d4d4c3 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:26.012350 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fe31c-86fc-4d86-81b0-d97f51d4d4c3 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:26.012350 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fe31c-86fc-4d86-81b0-d97f51d4d4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:26.030128 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-5f3fe31c-86fc-4d86-81b0-d97f51d4d4c3 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:42:26.031392 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-5f3fe31c-86fc-4d86-81b0-d97f51d4d4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:42:26.105118 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 452/896] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:42:26 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:42:26.438050 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5445632-dff8-45ee-ac64-4abc6f16deba None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:26.546568 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5445632-dff8-45ee-ac64-4abc6f16deba None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:26.562808 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:26.583523 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ff3a2-fdb7-48ad-b98b-e7c97922d166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:26.584161 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ff3a2-fdb7-48ad-b98b-e7c97922d166 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:26.584446 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ff3a2-fdb7-48ad-b98b-e7c97922d166 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:26.584718 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ff3a2-fdb7-48ad-b98b-e7c97922d166 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:26.595060 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ff3a2-fdb7-48ad-b98b-e7c97922d166 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:42:26.600385 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-800ff3a2-fdb7-48ad-b98b-e7c97922d166 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:42:26.600385 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:26.600385 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:42:26.600385 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:42:26.600385 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:42:26.600385 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:42:26.600385 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:42:26.600385 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:42:26.600385 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:42:26.600385 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:42:26.600385 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:42:26.600385 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:42:26.600385 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:42:26.600385 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:42:26.600385 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:42:26.600385 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:42:26.601518 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:42:26.601518 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:42:26.601518 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:42:26.601518 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:42:26.601518 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:42:26.601518 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:42:26.601518 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:42:26.601518 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:42:26.601518 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:42:26.601518 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:42:26.601518 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:42:26.601518 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:42:26.601518 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:42:26.601518 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:42:26.601518 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:42:26.601518 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:42:26.602422 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:42:26.602422 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:42:26.602422 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:42:26.602422 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:42:26.602422 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:42:26.602422 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:42:26.602422 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:42:26.602422 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:42:26.602422 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:42:26.602422 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:42:26.602422 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:42:26.602422 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:42:26.602422 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 445/897] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 26 00:42:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:42:26.607681 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fe31c-86fc-4d86-81b0-d97f51d4d4c3 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:26.696210 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:26.714841 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fe31c-86fc-4d86-81b0-d97f51d4d4c3 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:26.750831 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb4c70-60f8-4683-b69e-dd156a61e33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:26.751442 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb4c70-60f8-4683-b69e-dd156a61e33d None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:26.751730 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb4c70-60f8-4683-b69e-dd156a61e33d None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:26.752009 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb4c70-60f8-4683-b69e-dd156a61e33d None admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:26.752682 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb4c70-60f8-4683-b69e-dd156a61e33d None admin] RBAC: Adding query filter params (name=admin) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:26.752994 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb4c70-60f8-4683-b69e-dd156a61e33d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:26.754698 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb4c70-60f8-4683-b69e-dd156a61e33d None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:26.763479 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 453/898] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 26 00:42:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:26.771274 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ff3a2-fdb7-48ad-b98b-e7c97922d166 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:26.881792 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ff3a2-fdb7-48ad-b98b-e7c97922d166 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:26.925488 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755b739-c708-4cc2-829c-3e16fc1bbd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:26.926122 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755b739-c708-4cc2-829c-3e16fc1bbd9a None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:26.926430 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755b739-c708-4cc2-829c-3e16fc1bbd9a None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:26.926705 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755b739-c708-4cc2-829c-3e16fc1bbd9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:26.937146 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a755b739-c708-4cc2-829c-3e16fc1bbd9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:26.938751 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a755b739-c708-4cc2-829c-3e16fc1bbd9a None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:26.955244 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-a755b739-c708-4cc2-829c-3e16fc1bbd9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:42:26.955244 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:26.955244 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:42:26.955244 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:42:26.955244 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:42:26.955244 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:42:26.955244 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:42:26.955244 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:42:26.955244 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:42:26.955244 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:42:26.955244 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:42:26.955244 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:42:26.955244 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:42:26.955244 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:42:26.955244 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:42:26.955244 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:42:26.956284 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:42:26.956284 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:42:26.956284 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:42:26.956284 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:42:26.956284 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:42:26.956284 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:42:26.956284 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:42:26.956284 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:42:26.956284 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:42:26.956284 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:42:26.956284 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:42:26.956284 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:42:26.956284 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:42:26.956284 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:42:26.956284 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:42:26.956284 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:42:26.956284 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:42:26.958147 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:42:26.958147 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:42:26.958147 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:42:26.958147 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 446/899] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:42:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:42:26.962836 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb4c70-60f8-4683-b69e-dd156a61e33d None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:27.075068 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb4c70-60f8-4683-b69e-dd156a61e33d None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:27.109827 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db25635-20bf-47b0-aaff-eb539dfb04bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:27.110441 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db25635-20bf-47b0-aaff-eb539dfb04bb None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:27.110785 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db25635-20bf-47b0-aaff-eb539dfb04bb None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:27.111070 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db25635-20bf-47b0-aaff-eb539dfb04bb None admin] PATH_INFO: `/v3/domains` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:27.111732 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db25635-20bf-47b0-aaff-eb539dfb04bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:27.112039 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db25635-20bf-47b0-aaff-eb539dfb04bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:27.113447 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db25635-20bf-47b0-aaff-eb539dfb04bb None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:27.126208 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 454/900] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:27.133036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755b739-c708-4cc2-829c-3e16fc1bbd9a None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:27.162315 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:27.242010 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755b739-c708-4cc2-829c-3e16fc1bbd9a None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:27.278483 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf8fcd-edd0-4de6-9997-24e7e9b6a6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:27.279128 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf8fcd-edd0-4de6-9997-24e7e9b6a6aa None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:27.279414 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf8fcd-edd0-4de6-9997-24e7e9b6a6aa None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:27.279689 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf8fcd-edd0-4de6-9997-24e7e9b6a6aa None admin] PATH_INFO: `/v3/users/placement` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:27.288295 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf8fcd-edd0-4de6-9997-24e7e9b6a6aa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:27.289784 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf8fcd-edd0-4de6-9997-24e7e9b6a6aa None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:27.301955 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-04bf8fcd-edd0-4de6-9997-24e7e9b6a6aa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:42:27.301955 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:27.301955 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:42:27.301955 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:42:27.301955 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:42:27.301955 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:42:27.301955 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:42:27.301955 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:42:27.301955 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:42:27.301955 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:42:27.301955 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:42:27.301955 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:42:27.301955 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:42:27.301955 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:42:27.301955 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:42:27.301955 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:42:27.303193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:42:27.303193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:42:27.303193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:42:27.303193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:42:27.303193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:42:27.303193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:42:27.303193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:42:27.303193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:42:27.303193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:42:27.303193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:42:27.303193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:42:27.303193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:42:27.303193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:42:27.303193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:42:27.303193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:42:27.303193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:42:27.303193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:42:27.303193 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:42:27.304513 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:42:27.304513 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:42:27.304513 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:42:27.304513 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:42:27.304513 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:42:27.304513 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:42:27.304513 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:42:27.304513 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:42:27.304513 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:42:27.304513 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:42:27.304513 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 447/901] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:42:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:42:27.309058 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db25635-20bf-47b0-aaff-eb539dfb04bb None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:27.312911 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:27.416278 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db25635-20bf-47b0-aaff-eb539dfb04bb None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:27.454286 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c8213-ab88-4033-8223-25fc2ddaf44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:27.454892 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c8213-ab88-4033-8223-25fc2ddaf44c None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:27.455174 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c8213-ab88-4033-8223-25fc2ddaf44c None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:27.455443 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c8213-ab88-4033-8223-25fc2ddaf44c None admin] PATH_INFO: `/v3/users` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:27.456180 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c8213-ab88-4033-8223-25fc2ddaf44c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:27.456487 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c8213-ab88-4033-8223-25fc2ddaf44c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:27.458296 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c8213-ab88-4033-8223-25fc2ddaf44c None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:27.476704 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 455/902] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Aug 26 00:42:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:27.482490 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf8fcd-edd0-4de6-9997-24e7e9b6a6aa None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:27.580145 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:27.595450 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf8fcd-edd0-4de6-9997-24e7e9b6a6aa None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:27.634117 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d07045-f3b1-4d18-8c09-cddb3bd84d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:27.634803 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d07045-f3b1-4d18-8c09-cddb3bd84d9e None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:27.635085 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d07045-f3b1-4d18-8c09-cddb3bd84d9e None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:27.635389 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d07045-f3b1-4d18-8c09-cddb3bd84d9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:27.706550 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d07045-f3b1-4d18-8c09-cddb3bd84d9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:27.708482 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d07045-f3b1-4d18-8c09-cddb3bd84d9e None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:27.803257 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:27.815998 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 448/903] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 26 00:42:27 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:42:27.822564 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c8213-ab88-4033-8223-25fc2ddaf44c None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:27.889029 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:27.930524 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c8213-ab88-4033-8223-25fc2ddaf44c None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:27.966042 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c118b-d141-4de1-bf56-642f12076ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:27.966686 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c118b-d141-4de1-bf56-642f12076ae6 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:27.966973 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c118b-d141-4de1-bf56-642f12076ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:27.967254 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c118b-d141-4de1-bf56-642f12076ae6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:27.980806 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c118b-d141-4de1-bf56-642f12076ae6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:27.982667 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c118b-d141-4de1-bf56-642f12076ae6 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:28.000445 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-eb9c118b-d141-4de1-bf56-642f12076ae6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:42:28.000445 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:28.000445 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:42:28.000445 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:42:28.000445 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:42:28.000445 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:42:28.000445 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:42:28.000445 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:42:28.000445 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:42:28.000445 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:42:28.000445 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:42:28.000445 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:42:28.000445 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:42:28.000445 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:42:28.000445 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:42:28.000445 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:42:28.001722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:42:28.001722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:42:28.001722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:42:28.001722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:42:28.001722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:42:28.001722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:42:28.001722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:42:28.001722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:42:28.001722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:42:28.001722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:42:28.001722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:42:28.001722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:42:28.001722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:42:28.001722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:42:28.001722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:42:28.001722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:42:28.001722 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:42:28.002855 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:42:28.002855 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:42:28.002855 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:42:28.002855 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 456/904] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:42:28.012505 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d07045-f3b1-4d18-8c09-cddb3bd84d9e None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:28.126525 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d07045-f3b1-4d18-8c09-cddb3bd84d9e None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:28.165655 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10344d-253f-437e-99d6-164cfd3c177c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:28.166381 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10344d-253f-437e-99d6-164cfd3c177c None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:28.166602 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10344d-253f-437e-99d6-164cfd3c177c None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:28.166891 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10344d-253f-437e-99d6-164cfd3c177c None admin] PATH_INFO: `/v3/domains` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:28.167599 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10344d-253f-437e-99d6-164cfd3c177c None admin] RBAC: Adding query filter params (name=Default) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:28.167916 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10344d-253f-437e-99d6-164cfd3c177c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:28.169328 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10344d-253f-437e-99d6-164cfd3c177c None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:28.182213 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 449/905] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 26 00:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:28.187933 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c118b-d141-4de1-bf56-642f12076ae6 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:28.292447 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c118b-d141-4de1-bf56-642f12076ae6 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:28.306768 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:28.326944 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87747dcb-e1fc-4135-86e3-298d5c15926f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:28.327571 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87747dcb-e1fc-4135-86e3-298d5c15926f None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:28.327844 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87747dcb-e1fc-4135-86e3-298d5c15926f None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:28.328114 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87747dcb-e1fc-4135-86e3-298d5c15926f None admin] PATH_INFO: `/v3/projects/service` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:28.335663 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87747dcb-e1fc-4135-86e3-298d5c15926f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:28.337095 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87747dcb-e1fc-4135-86e3-298d5c15926f None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:28.348733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application [None req-87747dcb-e1fc-4135-86e3-298d5c15926f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:42:28.348733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:28.348733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:42:28.348733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:42:28.348733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:42:28.348733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:42:28.348733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:42:28.348733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:42:28.348733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:42:28.348733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:42:28.348733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:42:28.348733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:42:28.348733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:42:28.348733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:42:28.348733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:42:28.349953 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:42:28.349953 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:42:28.349953 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:42:28.349953 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:42:28.349953 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:42:28.349953 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:42:28.349953 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:42:28.349953 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:42:28.349953 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application with Lock( Aug 26 00:42:28.349953 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:42:28.349953 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:42:28.349953 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:42:28.349953 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:42:28.349953 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:42:28.349953 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:42:28.349953 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:42:28.349953 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:42:28.355777 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:42:28.355777 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:42:28.355777 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:42:28.355777 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:42:28.355777 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:42:28.355777 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:42:28.355777 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:42:28.355777 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: ERROR keystone.server.flask.application Aug 26 00:42:28.355777 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 457/906] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 26 00:42:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:42:28.356456 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10344d-253f-437e-99d6-164cfd3c177c None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:28.404718 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:28.459776 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10344d-253f-437e-99d6-164cfd3c177c None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:28.495825 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f5c86-dfa6-490f-97c4-953e6e31f842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:28.496437 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f5c86-dfa6-490f-97c4-953e6e31f842 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:28.496714 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f5c86-dfa6-490f-97c4-953e6e31f842 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:28.496987 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f5c86-dfa6-490f-97c4-953e6e31f842 None admin] PATH_INFO: `/v3/projects` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:28.497718 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f5c86-dfa6-490f-97c4-953e6e31f842 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:28.498031 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f5c86-dfa6-490f-97c4-953e6e31f842 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:28.499472 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f5c86-dfa6-490f-97c4-953e6e31f842 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:28.512391 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 450/907] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 26 00:42:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:28.519003 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87747dcb-e1fc-4135-86e3-298d5c15926f None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:28.624111 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87747dcb-e1fc-4135-86e3-298d5c15926f None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:28.659464 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff5ba9-fa08-449c-ac69-a000bec18e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:28.660080 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff5ba9-fa08-449c-ac69-a000bec18e4d None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:28.660366 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff5ba9-fa08-449c-ac69-a000bec18e4d None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:28.661055 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff5ba9-fa08-449c-ac69-a000bec18e4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:28.661402 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff5ba9-fa08-449c-ac69-a000bec18e4d None admin] RBAC: Adding query filter params (role.id=f13055bcebf847bf8b46160ded13810b, scope.project.id=fe7cc05cd9f44d74a635079ef883d9a9, user.id=d74675b1a7a34a95b41f7f8714d47e43) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:28.661935 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff5ba9-fa08-449c-ac69-a000bec18e4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:28.663176 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff5ba9-fa08-449c-ac69-a000bec18e4d None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:28.669568 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 458/908] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 26 00:42:28 2022] GET /identity/v3/role_assignments?user.id=d74675b1a7a34a95b41f7f8714d47e43&scope.project.id=fe7cc05cd9f44d74a635079ef883d9a9&role.id=f13055bcebf847bf8b46160ded13810b => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:42:30.929811 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88be18-7819-4480-aea7-fd95a62d824d None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:30.930377 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88be18-7819-4480-aea7-fd95a62d824d None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:30.930377 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88be18-7819-4480-aea7-fd95a62d824d None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:30.931719 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 451/909] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:42:30.937132 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9180cc-34a6-4f90-92c5-8683436efeb3 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:30.937646 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9180cc-34a6-4f90-92c5-8683436efeb3 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:30.937755 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9180cc-34a6-4f90-92c5-8683436efeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:30.956720 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-1f9180cc-34a6-4f90-92c5-8683436efeb3 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:42:30.959409 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-1f9180cc-34a6-4f90-92c5-8683436efeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:42:30.989866 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:31.028959 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 459/910] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:42:30 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:42:31.369128 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88be18-7819-4480-aea7-fd95a62d824d None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:31.484223 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88be18-7819-4480-aea7-fd95a62d824d None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:31.492587 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:31.521781 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2204fc4-a480-42bb-ab6e-c7d79f3a45a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:31.522439 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2204fc4-a480-42bb-ab6e-c7d79f3a45a3 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:31.522725 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2204fc4-a480-42bb-ab6e-c7d79f3a45a3 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:31.523002 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2204fc4-a480-42bb-ab6e-c7d79f3a45a3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:31.523592 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2204fc4-a480-42bb-ab6e-c7d79f3a45a3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:31.524982 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2204fc4-a480-42bb-ab6e-c7d79f3a45a3 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:31.534629 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-b2204fc4-a480-42bb-ab6e-c7d79f3a45a3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:42:31.534629 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:31.534629 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:42:31.534629 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:42:31.534629 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:42:31.534629 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:42:31.534629 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:42:31.534629 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:42:31.534629 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:42:31.534629 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:42:31.534629 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:42:31.534629 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:42:31.534629 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:31.534629 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:42:31.534629 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:42:31.534629 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:42:31.534629 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:42:31.536152 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:42:31.536152 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:42:31.536152 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:42:31.536152 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:42:31.536152 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:42:31.536152 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:42:31.536152 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:42:31.536152 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:42:31.536152 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:42:31.536152 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:42:31.536152 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:42:31.536152 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:42:31.536152 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:42:31.536152 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:42:31.536152 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:42:31.536152 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:42:31.537388 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:42:31.537388 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:42:31.537388 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:42:31.537388 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:42:31.537388 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:42:31.537388 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:42:31.537388 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:42:31.537388 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:42:31.537388 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:42:31.537388 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:42:31.537388 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:42:31.537388 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:42:31.537388 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:42:31.537388 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:42:31.537388 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 452/911] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Aug 26 00:42:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:42:31.541886 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9180cc-34a6-4f90-92c5-8683436efeb3 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:31.647342 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9180cc-34a6-4f90-92c5-8683436efeb3 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:31.684383 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2cf03-3676-462c-978b-2fd4a4adec88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:31.684992 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2cf03-3676-462c-978b-2fd4a4adec88 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:31.685278 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2cf03-3676-462c-978b-2fd4a4adec88 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:31.685584 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2cf03-3676-462c-978b-2fd4a4adec88 None admin] PATH_INFO: `/v3/services` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:31.686234 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b2cf03-3676-462c-978b-2fd4a4adec88 None admin] RBAC: Adding query filter params (name=placement) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:31.686538 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b2cf03-3676-462c-978b-2fd4a4adec88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:31.687992 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b2cf03-3676-462c-978b-2fd4a4adec88 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:31.693738 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 460/912] 10.222.0.20 () {56 vars in 1116 bytes} [Fri Aug 26 00:42:31 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:31.700132 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2204fc4-a480-42bb-ab6e-c7d79f3a45a3 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:31.805979 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2204fc4-a480-42bb-ab6e-c7d79f3a45a3 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:31.844210 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89c498-fc6b-4cf0-96fe-653810569636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:31.844821 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89c498-fc6b-4cf0-96fe-653810569636 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:31.845101 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89c498-fc6b-4cf0-96fe-653810569636 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:31.845415 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89c498-fc6b-4cf0-96fe-653810569636 None admin] PATH_INFO: `/v3/services` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:31.846036 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89c498-fc6b-4cf0-96fe-653810569636 None admin] RBAC: Adding query filter params (type=placement) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:31.846342 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89c498-fc6b-4cf0-96fe-653810569636 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:31.847766 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89c498-fc6b-4cf0-96fe-653810569636 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:31.852847 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 453/913] 10.222.0.20 () {56 vars in 1116 bytes} [Fri Aug 26 00:42:31 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:34.090819 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2fa0f-5aa0-4564-be9c-367d20fad0ea None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:34.091368 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2fa0f-5aa0-4564-be9c-367d20fad0ea None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:34.091368 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2fa0f-5aa0-4564-be9c-367d20fad0ea None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:34.092686 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 461/914] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:42:34.097914 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6694f04-8cb6-4ae2-bed8-96006ce353d9 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:34.098413 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6694f04-8cb6-4ae2-bed8-96006ce353d9 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:34.098874 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6694f04-8cb6-4ae2-bed8-96006ce353d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:34.118247 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-d6694f04-8cb6-4ae2-bed8-96006ce353d9 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:42:34.119453 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-d6694f04-8cb6-4ae2-bed8-96006ce353d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:42:34.147504 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:34.188830 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 454/915] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:42:34 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:42:34.521085 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2fa0f-5aa0-4564-be9c-367d20fad0ea None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:34.554422 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:34.627961 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2fa0f-5aa0-4564-be9c-367d20fad0ea None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:34.662606 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c7510-4fda-4ef5-ad5b-1f7aeca38a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:34.663215 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c7510-4fda-4ef5-ad5b-1f7aeca38a6b None admin] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:34.663497 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c7510-4fda-4ef5-ad5b-1f7aeca38a6b None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:34.663805 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c7510-4fda-4ef5-ad5b-1f7aeca38a6b None admin] PATH_INFO: `/v3/services` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:34.664487 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c7510-4fda-4ef5-ad5b-1f7aeca38a6b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:34.665902 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c7510-4fda-4ef5-ad5b-1f7aeca38a6b None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:34.825835 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 462/916] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 26 00:42:34 2022] POST /identity/v3/services => generated 246 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:42:37.061769 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fdbc8-029e-40f6-9dbf-203a9e77a7e7 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:37.062313 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fdbc8-029e-40f6-9dbf-203a9e77a7e7 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:37.062313 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fdbc8-029e-40f6-9dbf-203a9e77a7e7 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:37.063651 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 455/917] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:42:37.069568 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa44725-7db7-45d9-8b05-1877773df5eb None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:37.069981 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa44725-7db7-45d9-8b05-1877773df5eb None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:37.070139 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa44725-7db7-45d9-8b05-1877773df5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:37.089133 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-0fa44725-7db7-45d9-8b05-1877773df5eb None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:42:37.090360 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-0fa44725-7db7-45d9-8b05-1877773df5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:42:37.165010 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 463/918] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:42:37 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:42:37.498933 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fdbc8-029e-40f6-9dbf-203a9e77a7e7 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:37.608555 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fdbc8-029e-40f6-9dbf-203a9e77a7e7 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:37.643760 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6116a-bfaf-427c-8e9c-4c4d7afeeba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:37.644400 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6116a-bfaf-427c-8e9c-4c4d7afeeba2 None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:37.644836 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6116a-bfaf-427c-8e9c-4c4d7afeeba2 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:37.645222 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6116a-bfaf-427c-8e9c-4c4d7afeeba2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:37.645877 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e6116a-bfaf-427c-8e9c-4c4d7afeeba2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:37.647310 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e6116a-bfaf-427c-8e9c-4c4d7afeeba2 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:37.656844 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-11e6116a-bfaf-427c-8e9c-4c4d7afeeba2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:42:37.656844 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:37.656844 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:42:37.656844 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:42:37.656844 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:42:37.656844 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:42:37.656844 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:42:37.656844 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:42:37.656844 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:42:37.656844 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:42:37.656844 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:42:37.656844 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:42:37.656844 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:37.656844 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:42:37.656844 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:42:37.656844 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:42:37.656844 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:42:37.658092 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:42:37.658092 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:42:37.658092 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:42:37.658092 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:42:37.658092 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:42:37.658092 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:42:37.658092 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:42:37.658092 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:42:37.658092 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:42:37.658092 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:42:37.658092 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:42:37.658092 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:42:37.658092 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:42:37.658092 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:42:37.658092 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:42:37.658092 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:42:37.659347 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:42:37.659347 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:42:37.659347 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:42:37.659347 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:42:37.659347 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:42:37.659347 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:42:37.659347 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:42:37.659347 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:42:37.659347 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:42:37.659347 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:42:37.659347 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:42:37.659347 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:42:37.659347 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:42:37.659347 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:42:37.659347 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 456/919] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Aug 26 00:42:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:42:37.665188 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa44725-7db7-45d9-8b05-1877773df5eb None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:37.686564 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:37.768963 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa44725-7db7-45d9-8b05-1877773df5eb None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:37.807802 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf37cd-9500-43c4-af64-5ae58bfaccd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:37.808439 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf37cd-9500-43c4-af64-5ae58bfaccd2 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:37.808763 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf37cd-9500-43c4-af64-5ae58bfaccd2 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:37.809071 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf37cd-9500-43c4-af64-5ae58bfaccd2 None admin] PATH_INFO: `/v3/services` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:37.809733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf37cd-9500-43c4-af64-5ae58bfaccd2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:37.810036 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf37cd-9500-43c4-af64-5ae58bfaccd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:37.811386 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf37cd-9500-43c4-af64-5ae58bfaccd2 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:37.816581 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 464/920] 10.222.0.20 () {56 vars in 1116 bytes} [Fri Aug 26 00:42:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:37.822816 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6116a-bfaf-427c-8e9c-4c4d7afeeba2 None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:37.852611 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:37.926411 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6116a-bfaf-427c-8e9c-4c4d7afeeba2 None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:37.961033 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d9052-8d72-46a8-b1ae-b2a8051fff4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:37.961671 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d9052-8d72-46a8-b1ae-b2a8051fff4b None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:37.961950 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d9052-8d72-46a8-b1ae-b2a8051fff4b None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:37.962219 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d9052-8d72-46a8-b1ae-b2a8051fff4b None admin] PATH_INFO: `/v3/endpoints` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:37.962917 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d9052-8d72-46a8-b1ae-b2a8051fff4b None admin] RBAC: Adding query filter params (interface=public, service_id=754a77ffb4de44728ab69c47dc730a5f, region_id=RegionOne) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:37.963227 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d9052-8d72-46a8-b1ae-b2a8051fff4b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:37.964596 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d9052-8d72-46a8-b1ae-b2a8051fff4b None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:37.969466 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 457/921] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Aug 26 00:42:37 2022] GET /identity/v3/endpoints?service_id=754a77ffb4de44728ab69c47dc730a5f&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:42:37.976032 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf37cd-9500-43c4-af64-5ae58bfaccd2 None admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:38.085658 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:38.106585 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf37cd-9500-43c4-af64-5ae58bfaccd2 None admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:38.140747 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5afb387-7554-4788-a541-550965c9b744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:38.141356 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afb387-7554-4788-a541-550965c9b744 None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:38.141670 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afb387-7554-4788-a541-550965c9b744 None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:38.141945 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afb387-7554-4788-a541-550965c9b744 None admin] PATH_INFO: `/v3/services` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:38.142560 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5afb387-7554-4788-a541-550965c9b744 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:38.143930 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5afb387-7554-4788-a541-550965c9b744 None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:38.151439 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 465/922] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Aug 26 00:42:37 2022] GET /identity/v3/services => generated 1962 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:42:40.367875 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3232d-a4a5-4aec-b14e-74093ee01d4a None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:40.368441 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3232d-a4a5-4aec-b14e-74093ee01d4a None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:40.368441 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3232d-a4a5-4aec-b14e-74093ee01d4a None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:40.369848 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 458/923] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:42:40.375278 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60e576-d7d0-49b7-87e4-37445b9ef369 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:40.375743 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60e576-d7d0-49b7-87e4-37445b9ef369 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:40.375843 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60e576-d7d0-49b7-87e4-37445b9ef369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:40.394599 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-dd60e576-d7d0-49b7-87e4-37445b9ef369 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:42:40.396001 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-dd60e576-d7d0-49b7-87e4-37445b9ef369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:42:40.465642 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 466/924] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:42:40 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:42:40.796818 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3232d-a4a5-4aec-b14e-74093ee01d4a None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:40.903030 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:40.915574 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3232d-a4a5-4aec-b14e-74093ee01d4a None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:40.953094 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357de029-c917-4b9f-ba06-12355c79970f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:40.953840 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357de029-c917-4b9f-ba06-12355c79970f None admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:40.954128 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357de029-c917-4b9f-ba06-12355c79970f None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:40.954408 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357de029-c917-4b9f-ba06-12355c79970f None admin] PATH_INFO: `/v3/services/placement` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:40.955000 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357de029-c917-4b9f-ba06-12355c79970f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:40.956449 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357de029-c917-4b9f-ba06-12355c79970f None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:40.966699 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application [None req-357de029-c917-4b9f-ba06-12355c79970f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:42:40.966699 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:40.966699 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:42:40.966699 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:42:40.966699 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:42:40.966699 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:42:40.966699 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:42:40.966699 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:42:40.966699 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:42:40.966699 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:42:40.966699 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:42:40.966699 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:42:40.966699 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:42:40.966699 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:42:40.966699 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:42:40.966699 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:42:40.966699 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:42:40.967962 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:42:40.967962 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:42:40.967962 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:42:40.967962 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:42:40.967962 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:42:40.967962 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:42:40.967962 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:42:40.967962 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:42:40.967962 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:42:40.967962 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:42:40.967962 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:42:40.967962 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:42:40.967962 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:42:40.967962 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:42:40.967962 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:42:40.967962 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:42:40.969183 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:42:40.969183 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application with Lock( Aug 26 00:42:40.969183 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:42:40.969183 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:42:40.969183 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:42:40.969183 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:42:40.969183 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:42:40.969183 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:42:40.969183 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:42:40.969183 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:42:40.969183 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:42:40.969183 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:42:40.969183 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:42:40.969183 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: ERROR keystone.server.flask.application Aug 26 00:42:40.969183 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 459/925] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Aug 26 00:42:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:42:40.974824 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60e576-d7d0-49b7-87e4-37445b9ef369 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:41.054752 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:41.078602 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60e576-d7d0-49b7-87e4-37445b9ef369 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:41.115082 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37200e-efab-4d16-982c-8e900a54c3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:41.115836 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37200e-efab-4d16-982c-8e900a54c3ef None admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:41.116122 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37200e-efab-4d16-982c-8e900a54c3ef None admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:41.116399 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37200e-efab-4d16-982c-8e900a54c3ef None admin] PATH_INFO: `/v3/services` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:41.117038 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b37200e-efab-4d16-982c-8e900a54c3ef None admin] RBAC: Adding query filter params (name=placement) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:42:41.117400 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b37200e-efab-4d16-982c-8e900a54c3ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:41.118779 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b37200e-efab-4d16-982c-8e900a54c3ef None admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:41.124316 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 467/926] 10.222.0.20 () {56 vars in 1116 bytes} [Fri Aug 26 00:42:40 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:42:41.130284 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357de029-c917-4b9f-ba06-12355c79970f None admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:41.231633 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357de029-c917-4b9f-ba06-12355c79970f None admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:41.267137 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870d4b2-2964-474f-80d0-72ca61b94408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:41.267745 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870d4b2-2964-474f-80d0-72ca61b94408 None admin] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:41.268043 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870d4b2-2964-474f-80d0-72ca61b94408 None admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:41.268300 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870d4b2-2964-474f-80d0-72ca61b94408 None admin] PATH_INFO: `/v3/endpoints` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:41.268961 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870d4b2-2964-474f-80d0-72ca61b94408 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:41.270949 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870d4b2-2964-474f-80d0-72ca61b94408 None admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:41.392892 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 460/927] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 00:42:41 2022] POST /identity/v3/endpoints => generated 331 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:42:51.169033 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=30 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:51.387759 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:29.530499 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443d7fd-ed6d-452c-baf6-e9619fb9f949 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:29.530499 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443d7fd-ed6d-452c-baf6-e9619fb9f949 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:29.531096 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443d7fd-ed6d-452c-baf6-e9619fb9f949 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:29.532017 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 468/928] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:50:29.537748 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bf599-32d6-43ef-a652-ec791011f6f4 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:29.538246 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bf599-32d6-43ef-a652-ec791011f6f4 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:29.538332 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bf599-32d6-43ef-a652-ec791011f6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:29.659083 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-681bf599-32d6-43ef-a652-ec791011f6f4 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:29.660556 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-681bf599-32d6-43ef-a652-ec791011f6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:29.792534 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 461/929] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:50:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:50:30.162704 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12c971-a918-44dd-8e96-8746691cfee7 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:30.162704 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12c971-a918-44dd-8e96-8746691cfee7 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:30.162704 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12c971-a918-44dd-8e96-8746691cfee7 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:30.162704 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 469/930] 10.222.0.20 () {54 vars in 965 bytes} [Fri Aug 26 00:50:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:50:30.169495 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab6aef-4ea9-45f1-ba08-06fddb88fcea None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:30.171218 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab6aef-4ea9-45f1-ba08-06fddb88fcea None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:30.171218 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab6aef-4ea9-45f1-ba08-06fddb88fcea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:30.261912 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-aeab6aef-4ea9-45f1-ba08-06fddb88fcea None None] MFA Rules not processed for user `fd3d4bf8049a44749b6be1d565303176`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:30.263187 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-aeab6aef-4ea9-45f1-ba08-06fddb88fcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:30.298799 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:30.351179 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 462/931] 10.222.0.20 () {58 vars in 1062 bytes} [Fri Aug 26 00:50:30 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:50:30.360741 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12c971-a918-44dd-8e96-8746691cfee7 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:30.375283 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12c971-a918-44dd-8e96-8746691cfee7 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:30.379090 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6a29e-b672-4ce9-a3d9-332d43c95c3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:30.379698 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6a29e-b672-4ce9-a3d9-332d43c95c3e service neutron] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:30.380087 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6a29e-b672-4ce9-a3d9-332d43c95c3e service neutron] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:30.380260 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6a29e-b672-4ce9-a3d9-332d43c95c3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:30.391463 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6a29e-b672-4ce9-a3d9-332d43c95c3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:30.392862 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6a29e-b672-4ce9-a3d9-332d43c95c3e service neutron] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:30.405172 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 470/932] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:50:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:50:33.004160 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afc413-4e96-404b-a145-d1d7dd9b6db1 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:33.004765 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afc413-4e96-404b-a145-d1d7dd9b6db1 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:33.004765 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afc413-4e96-404b-a145-d1d7dd9b6db1 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:33.006223 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 463/933] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:50:33.012730 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67643807-4a0a-4255-a506-3e5e89029851 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:33.013250 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67643807-4a0a-4255-a506-3e5e89029851 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:33.013327 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67643807-4a0a-4255-a506-3e5e89029851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:33.035456 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-67643807-4a0a-4255-a506-3e5e89029851 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:33.036949 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-67643807-4a0a-4255-a506-3e5e89029851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:33.045978 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 471/934] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:50:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:50:33.418466 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afc413-4e96-404b-a145-d1d7dd9b6db1 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:33.418466 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afc413-4e96-404b-a145-d1d7dd9b6db1 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:33.418466 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31b156-c119-4440-8c02-983af54d3c32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:33.418466 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31b156-c119-4440-8c02-983af54d3c32 service neutron] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:33.418936 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31b156-c119-4440-8c02-983af54d3c32 service neutron] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:33.418936 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31b156-c119-4440-8c02-983af54d3c32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:33.428911 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31b156-c119-4440-8c02-983af54d3c32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:33.430540 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31b156-c119-4440-8c02-983af54d3c32 service neutron] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:33.441761 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 464/935] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:50:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:50:36.297413 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05b8ef-16b0-4d55-9995-3c3a9ae30dff None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:36.297951 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05b8ef-16b0-4d55-9995-3c3a9ae30dff None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:36.297951 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05b8ef-16b0-4d55-9995-3c3a9ae30dff None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:36.299238 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 472/936] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:50:36.304565 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e8d51-1d8e-4e93-a23d-6da35915eb12 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:36.304992 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e8d51-1d8e-4e93-a23d-6da35915eb12 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:36.305125 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e8d51-1d8e-4e93-a23d-6da35915eb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:36.370585 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-d20e8d51-1d8e-4e93-a23d-6da35915eb12 None None] MFA Rules not processed for user `18e223919a594043ac62adff17d731d8`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:36.371829 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-d20e8d51-1d8e-4e93-a23d-6da35915eb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:36.459888 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 465/937] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:50:36 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:50:36.823845 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21d438-3ac4-41ad-a577-00bed51d930a None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:36.824130 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21d438-3ac4-41ad-a577-00bed51d930a None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:36.824407 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21d438-3ac4-41ad-a577-00bed51d930a None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:36.825803 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 473/938] 10.222.0.20 () {54 vars in 965 bytes} [Fri Aug 26 00:50:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:50:36.831902 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103112dc-1d76-4dcb-a51d-366a573053fd None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:36.832269 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103112dc-1d76-4dcb-a51d-366a573053fd None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:36.832619 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103112dc-1d76-4dcb-a51d-366a573053fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:36.857572 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-103112dc-1d76-4dcb-a51d-366a573053fd None None] MFA Rules not processed for user `fd3d4bf8049a44749b6be1d565303176`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:36.858806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-103112dc-1d76-4dcb-a51d-366a573053fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:36.865362 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 466/939] 10.222.0.20 () {58 vars in 1062 bytes} [Fri Aug 26 00:50:36 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:50:36.875145 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21d438-3ac4-41ad-a577-00bed51d930a None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:36.886615 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21d438-3ac4-41ad-a577-00bed51d930a None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:36.890040 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35930cc4-00cf-4e19-910f-979cb0dd28bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:36.890623 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35930cc4-00cf-4e19-910f-979cb0dd28bc service neutron] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:36.890899 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35930cc4-00cf-4e19-910f-979cb0dd28bc service neutron] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:36.891168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35930cc4-00cf-4e19-910f-979cb0dd28bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:36.900594 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35930cc4-00cf-4e19-910f-979cb0dd28bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:36.902104 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35930cc4-00cf-4e19-910f-979cb0dd28bc service neutron] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:36.912304 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 474/940] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:50:36 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:50:40.406754 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d556f42-45bb-4623-92a8-b852ab9cb0a5 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:40.407295 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d556f42-45bb-4623-92a8-b852ab9cb0a5 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:40.407295 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d556f42-45bb-4623-92a8-b852ab9cb0a5 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:40.408690 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 467/941] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:50:40.414293 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db10a5-6db8-4616-aef6-a1a9c4795791 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:40.419725 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db10a5-6db8-4616-aef6-a1a9c4795791 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:40.419725 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db10a5-6db8-4616-aef6-a1a9c4795791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:40.434276 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-b8db10a5-6db8-4616-aef6-a1a9c4795791 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:40.435498 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-b8db10a5-6db8-4616-aef6-a1a9c4795791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:40.513151 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 475/942] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:50:40 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:50:40.864820 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d556f42-45bb-4623-92a8-b852ab9cb0a5 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:40.876441 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d556f42-45bb-4623-92a8-b852ab9cb0a5 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:40.880075 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fb5ca-b7f6-4f6c-acbc-ce6e7568a3d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:40.880686 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fb5ca-b7f6-4f6c-acbc-ce6e7568a3d6 service neutron] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:40.880971 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fb5ca-b7f6-4f6c-acbc-ce6e7568a3d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:40.881247 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fb5ca-b7f6-4f6c-acbc-ce6e7568a3d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:40.890758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fb5ca-b7f6-4f6c-acbc-ce6e7568a3d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:40.892199 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fb5ca-b7f6-4f6c-acbc-ce6e7568a3d6 service neutron] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:40.901684 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 468/943] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:50:40 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:50:44.736453 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d25980-89dd-44c7-9bb9-41054f45fd69 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:44.736985 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d25980-89dd-44c7-9bb9-41054f45fd69 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:44.736985 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d25980-89dd-44c7-9bb9-41054f45fd69 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:44.738371 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 476/944] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:50:44.744363 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17f6a8-65f9-4209-acac-1196831b76a3 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:44.744787 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17f6a8-65f9-4209-acac-1196831b76a3 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:44.745022 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17f6a8-65f9-4209-acac-1196831b76a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:44.764386 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-da17f6a8-65f9-4209-acac-1196831b76a3 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:44.765768 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-da17f6a8-65f9-4209-acac-1196831b76a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:44.774055 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 469/945] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:50:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:50:45.120552 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d25980-89dd-44c7-9bb9-41054f45fd69 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:45.131169 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d25980-89dd-44c7-9bb9-41054f45fd69 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:45.135556 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711488e-deab-4874-b15c-f0be4113b959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:45.136199 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711488e-deab-4874-b15c-f0be4113b959 service neutron] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:45.136477 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711488e-deab-4874-b15c-f0be4113b959 service neutron] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:45.136899 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711488e-deab-4874-b15c-f0be4113b959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:45.145964 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711488e-deab-4874-b15c-f0be4113b959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:45.147404 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711488e-deab-4874-b15c-f0be4113b959 service neutron] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:45.157261 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 477/946] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:50:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:50:47.444563 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098ca00-e320-496a-bec6-547eaa933299 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:47.445101 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098ca00-e320-496a-bec6-547eaa933299 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:47.445101 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098ca00-e320-496a-bec6-547eaa933299 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:47.446826 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 470/947] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:50:47.452434 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe25bfa-3999-4705-9129-40919a7e3ce8 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:47.452911 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe25bfa-3999-4705-9129-40919a7e3ce8 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:47.453001 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe25bfa-3999-4705-9129-40919a7e3ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:47.471988 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-8fe25bfa-3999-4705-9129-40919a7e3ce8 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:47.473202 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-8fe25bfa-3999-4705-9129-40919a7e3ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:47.481542 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 478/948] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:50:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:50:47.829847 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098ca00-e320-496a-bec6-547eaa933299 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:47.842756 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098ca00-e320-496a-bec6-547eaa933299 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:47.846471 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39165618-d340-41c5-9548-df7c57badc3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:47.847101 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39165618-d340-41c5-9548-df7c57badc3a service neutron] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:47.847379 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39165618-d340-41c5-9548-df7c57badc3a service neutron] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:47.847652 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39165618-d340-41c5-9548-df7c57badc3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:47.858644 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39165618-d340-41c5-9548-df7c57badc3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:47.860106 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39165618-d340-41c5-9548-df7c57badc3a service neutron] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:47.871604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 471/949] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:50:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:50:50.161961 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac5467-656e-403f-aa8c-dac03ce36255 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:50.162487 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac5467-656e-403f-aa8c-dac03ce36255 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:50.162622 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac5467-656e-403f-aa8c-dac03ce36255 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:50.163987 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 479/950] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:50:50.169585 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843b582-4c29-4d24-9320-129a41fc6cc1 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:50.170014 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843b582-4c29-4d24-9320-129a41fc6cc1 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:50.170248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843b582-4c29-4d24-9320-129a41fc6cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:50.189878 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-e843b582-4c29-4d24-9320-129a41fc6cc1 None None] MFA Rules not processed for user `18e223919a594043ac62adff17d731d8`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:50.191098 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-e843b582-4c29-4d24-9320-129a41fc6cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:50.199722 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 472/951] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:50:50 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:50:50.545824 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac5467-656e-403f-aa8c-dac03ce36255 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:50.557498 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac5467-656e-403f-aa8c-dac03ce36255 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:50.560975 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd84ebc-24bb-42ec-8927-f478f2368f05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:50.561605 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd84ebc-24bb-42ec-8927-f478f2368f05 service neutron] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:50.561884 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd84ebc-24bb-42ec-8927-f478f2368f05 service neutron] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:50.562154 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd84ebc-24bb-42ec-8927-f478f2368f05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:50.571740 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd84ebc-24bb-42ec-8927-f478f2368f05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:50.573314 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd84ebc-24bb-42ec-8927-f478f2368f05 service neutron] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:50.583147 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 480/952] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:50:50 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:50:53.223895 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618bcb3-2056-4155-bd90-22da20d1acb0 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:53.224701 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618bcb3-2056-4155-bd90-22da20d1acb0 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:53.224701 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618bcb3-2056-4155-bd90-22da20d1acb0 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:53.225708 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 473/953] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:50:53.231978 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac9f84-26af-44f6-aab2-f3f3d5662448 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:53.232422 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac9f84-26af-44f6-aab2-f3f3d5662448 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:53.232422 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac9f84-26af-44f6-aab2-f3f3d5662448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:53.240223 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=62 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:53.252800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-37ac9f84-26af-44f6-aab2-f3f3d5662448 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:53.254045 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-37ac9f84-26af-44f6-aab2-f3f3d5662448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:53.262215 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 481/954] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:50:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:50:53.601719 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618bcb3-2056-4155-bd90-22da20d1acb0 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:53.608536 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:53.613238 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618bcb3-2056-4155-bd90-22da20d1acb0 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:53.616831 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a025dd9-e6e3-4cf0-95a6-e8973bee6644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:53.617470 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a025dd9-e6e3-4cf0-95a6-e8973bee6644 service neutron] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:53.617754 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a025dd9-e6e3-4cf0-95a6-e8973bee6644 service neutron] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:53.618051 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a025dd9-e6e3-4cf0-95a6-e8973bee6644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:53.627848 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a025dd9-e6e3-4cf0-95a6-e8973bee6644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:53.629331 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a025dd9-e6e3-4cf0-95a6-e8973bee6644 service neutron] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:53.639625 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 474/955] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:50:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:50:55.923117 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8a6c1-bc38-46d1-af5c-356360a6bc5e None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:55.923663 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8a6c1-bc38-46d1-af5c-356360a6bc5e None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:55.923663 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8a6c1-bc38-46d1-af5c-356360a6bc5e None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:55.925066 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 482/956] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:50:55.931238 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0c190-7dff-48c1-b75d-c1b3fa4df55f None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:55.931714 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0c190-7dff-48c1-b75d-c1b3fa4df55f None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:55.931814 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0c190-7dff-48c1-b75d-c1b3fa4df55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:55.951677 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-61f0c190-7dff-48c1-b75d-c1b3fa4df55f None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:55.952832 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-61f0c190-7dff-48c1-b75d-c1b3fa4df55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:55.961064 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 475/957] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:50:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:50:56.318820 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8a6c1-bc38-46d1-af5c-356360a6bc5e None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:56.322147 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8a6c1-bc38-46d1-af5c-356360a6bc5e None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:56.325691 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f9eae-79a6-4814-bdc0-153082bdb3f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:56.326316 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f9eae-79a6-4814-bdc0-153082bdb3f0 service neutron] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:56.326597 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f9eae-79a6-4814-bdc0-153082bdb3f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:56.326874 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f9eae-79a6-4814-bdc0-153082bdb3f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:56.336686 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f9eae-79a6-4814-bdc0-153082bdb3f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:56.338328 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f9eae-79a6-4814-bdc0-153082bdb3f0 service neutron] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:56.348089 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 483/958] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:50:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:50:59.328706 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260be97-c53b-4322-918a-c0a553d2ab07 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:59.329217 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260be97-c53b-4322-918a-c0a553d2ab07 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:59.329217 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260be97-c53b-4322-918a-c0a553d2ab07 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:59.330540 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 476/959] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:50:59.335793 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4025d15-f383-4424-8989-9a223530ccb1 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:59.336236 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4025d15-f383-4424-8989-9a223530ccb1 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:59.336330 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4025d15-f383-4424-8989-9a223530ccb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:59.356932 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-b4025d15-f383-4424-8989-9a223530ccb1 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:59.358201 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-b4025d15-f383-4424-8989-9a223530ccb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:59.366154 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 484/960] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:50:59 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:50:59.716079 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260be97-c53b-4322-918a-c0a553d2ab07 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:59.730488 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260be97-c53b-4322-918a-c0a553d2ab07 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:59.733977 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a997d-1dea-4106-8b69-3115f49bd13d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:59.734569 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a997d-1dea-4106-8b69-3115f49bd13d service neutron] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:59.734848 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a997d-1dea-4106-8b69-3115f49bd13d service neutron] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:59.735118 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a997d-1dea-4106-8b69-3115f49bd13d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:59.744670 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a997d-1dea-4106-8b69-3115f49bd13d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:59.746125 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a997d-1dea-4106-8b69-3115f49bd13d service neutron] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:59.755386 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 477/961] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:50:59 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:51:04.438041 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55dba7-722c-4710-a008-76133b09bb3a None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:04.438614 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55dba7-722c-4710-a008-76133b09bb3a None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:04.438614 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55dba7-722c-4710-a008-76133b09bb3a None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:04.440021 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 485/962] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:51:04.445590 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c20ed-b558-4451-9ffb-267adcd620fc None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:04.446292 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c20ed-b558-4451-9ffb-267adcd620fc None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:04.446393 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c20ed-b558-4451-9ffb-267adcd620fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:04.467007 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-da6c20ed-b558-4451-9ffb-267adcd620fc None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:04.468220 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-da6c20ed-b558-4451-9ffb-267adcd620fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:04.476057 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 478/963] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:51:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:51:04.828012 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55dba7-722c-4710-a008-76133b09bb3a None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:04.839420 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55dba7-722c-4710-a008-76133b09bb3a None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:04.843012 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79b3ea-8e81-4158-88c6-0c0b934f6144 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:04.843604 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79b3ea-8e81-4158-88c6-0c0b934f6144 service neutron] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:04.843881 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79b3ea-8e81-4158-88c6-0c0b934f6144 service neutron] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:04.844148 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79b3ea-8e81-4158-88c6-0c0b934f6144 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:04.854665 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79b3ea-8e81-4158-88c6-0c0b934f6144 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:04.856089 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79b3ea-8e81-4158-88c6-0c0b934f6144 service neutron] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:04.865796 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 486/964] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:51:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:51:08.260189 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba505a3-f6bc-4178-832a-8f888a7378d8 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:08.260743 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba505a3-f6bc-4178-832a-8f888a7378d8 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:08.260743 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba505a3-f6bc-4178-832a-8f888a7378d8 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:08.262113 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 479/965] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:51:08.267768 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406f24a-61d7-4429-9f64-76e5ea933d11 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:08.268229 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406f24a-61d7-4429-9f64-76e5ea933d11 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:08.268330 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406f24a-61d7-4429-9f64-76e5ea933d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:08.288424 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-1406f24a-61d7-4429-9f64-76e5ea933d11 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:08.290453 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-1406f24a-61d7-4429-9f64-76e5ea933d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:08.298544 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 487/966] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:51:08 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:51:08.653950 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba505a3-f6bc-4178-832a-8f888a7378d8 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:08.666220 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba505a3-f6bc-4178-832a-8f888a7378d8 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:08.671045 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a51d2-2bad-4d2d-89f5-5df9554f887e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:08.671703 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a51d2-2bad-4d2d-89f5-5df9554f887e service neutron] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:08.671989 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a51d2-2bad-4d2d-89f5-5df9554f887e service neutron] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:08.672267 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a51d2-2bad-4d2d-89f5-5df9554f887e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:08.682201 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a51d2-2bad-4d2d-89f5-5df9554f887e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:08.683764 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a51d2-2bad-4d2d-89f5-5df9554f887e service neutron] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:08.694105 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 480/967] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:51:08 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:51:13.386727 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367522d7-6570-4d23-b30d-b8eb8bea572f None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:13.387319 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367522d7-6570-4d23-b30d-b8eb8bea572f None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:13.387395 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367522d7-6570-4d23-b30d-b8eb8bea572f None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:13.388734 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 488/968] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:51:13.404235 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278c999-7466-4f70-a3b1-771c54331ede None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:13.404235 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278c999-7466-4f70-a3b1-771c54331ede None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:13.404235 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278c999-7466-4f70-a3b1-771c54331ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:13.416370 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-5278c999-7466-4f70-a3b1-771c54331ede None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:13.417616 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-5278c999-7466-4f70-a3b1-771c54331ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:13.425735 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 481/969] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:51:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:51:13.783815 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367522d7-6570-4d23-b30d-b8eb8bea572f None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:13.796484 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367522d7-6570-4d23-b30d-b8eb8bea572f None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:13.800238 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ae4be-95f3-4580-8ff7-185e7cb08491 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:13.800850 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ae4be-95f3-4580-8ff7-185e7cb08491 service neutron] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:13.805119 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ae4be-95f3-4580-8ff7-185e7cb08491 service neutron] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:13.805119 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ae4be-95f3-4580-8ff7-185e7cb08491 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:13.811865 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ae4be-95f3-4580-8ff7-185e7cb08491 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:13.813487 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ae4be-95f3-4580-8ff7-185e7cb08491 service neutron] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:13.828080 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 489/970] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:51:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:51:19.470827 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd4bc1-b6ab-4dd6-b57e-96b33288de8a None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:19.471351 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd4bc1-b6ab-4dd6-b57e-96b33288de8a None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:19.471471 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd4bc1-b6ab-4dd6-b57e-96b33288de8a None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:19.472897 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 482/971] 10.222.0.20 () {54 vars in 921 bytes} [Fri Aug 26 00:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:51:19.477942 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891b10f-2856-47e3-bae5-40a1a114d1ba None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:19.478720 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891b10f-2856-47e3-bae5-40a1a114d1ba None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:19.479006 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891b10f-2856-47e3-bae5-40a1a114d1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:19.575376 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-3891b10f-2856-47e3-bae5-40a1a114d1ba None None] MFA Rules not processed for user `d74675b1a7a34a95b41f7f8714d47e43`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:19.576991 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-3891b10f-2856-47e3-bae5-40a1a114d1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:19.661013 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 490/972] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Aug 26 00:51:19 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:51:23.410525 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=25 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:24.416966 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8c8a3-355d-4854-8c00-3201909d2408 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:24.418035 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8c8a3-355d-4854-8c00-3201909d2408 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:24.418319 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8c8a3-355d-4854-8c00-3201909d2408 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:24.420119 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 483/973] 10.222.0.20 () {54 vars in 921 bytes} [Fri Aug 26 00:51:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:51:24.425732 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bd724-6cec-409f-8576-29759ab4a6d4 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:24.426338 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bd724-6cec-409f-8576-29759ab4a6d4 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:24.426515 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bd724-6cec-409f-8576-29759ab4a6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:24.436055 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=66 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:24.451219 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-d94bd724-6cec-409f-8576-29759ab4a6d4 None None] MFA Rules not processed for user `d74675b1a7a34a95b41f7f8714d47e43`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:24.453114 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-d94bd724-6cec-409f-8576-29759ab4a6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:24.463411 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 491/974] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Aug 26 00:51:24 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:51:26.091265 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d5a3b-06fb-46cb-bea6-c94510d028f5 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:26.092104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d5a3b-06fb-46cb-bea6-c94510d028f5 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:26.092104 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d5a3b-06fb-46cb-bea6-c94510d028f5 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:26.094597 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 484/975] 10.222.0.20 () {54 vars in 921 bytes} [Fri Aug 26 00:51:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:51:26.102201 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b12b05-3a29-4c7c-9828-b5891c84b0a3 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:26.102804 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b12b05-3a29-4c7c-9828-b5891c84b0a3 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:26.103208 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b12b05-3a29-4c7c-9828-b5891c84b0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:26.136727 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-a7b12b05-3a29-4c7c-9828-b5891c84b0a3 None None] MFA Rules not processed for user `d74675b1a7a34a95b41f7f8714d47e43`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:26.138555 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-a7b12b05-3a29-4c7c-9828-b5891c84b0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:26.150761 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 492/976] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Aug 26 00:51:26 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:51:30.065786 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a8dd4-728d-4166-9c64-b9d20212cc58 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:30.066313 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a8dd4-728d-4166-9c64-b9d20212cc58 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:30.066313 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a8dd4-728d-4166-9c64-b9d20212cc58 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:30.067662 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 485/977] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:51:30.074356 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2c860-e436-487d-b3ce-4e76af88852f None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:30.074799 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2c860-e436-487d-b3ce-4e76af88852f None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:30.074891 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2c860-e436-487d-b3ce-4e76af88852f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:30.095318 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-97d2c860-e436-487d-b3ce-4e76af88852f None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:30.096536 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-97d2c860-e436-487d-b3ce-4e76af88852f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:30.112182 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 493/978] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:51:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:51:30.506178 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd784a9-1ee5-492a-a0ff-6b6543e3a77c None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:30.506877 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd784a9-1ee5-492a-a0ff-6b6543e3a77c None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:30.507633 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd784a9-1ee5-492a-a0ff-6b6543e3a77c None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:30.509710 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 486/979] 10.222.0.20 () {54 vars in 962 bytes} [Fri Aug 26 00:51:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:51:30.519943 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40db05a-854b-4ff6-8fbc-cbbd2d98a3c9 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:30.520231 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40db05a-854b-4ff6-8fbc-cbbd2d98a3c9 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:30.520710 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40db05a-854b-4ff6-8fbc-cbbd2d98a3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:30.576954 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-c40db05a-854b-4ff6-8fbc-cbbd2d98a3c9 None None] MFA Rules not processed for user `02f74984033043ecabd28df33960a37c`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:30.578271 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-c40db05a-854b-4ff6-8fbc-cbbd2d98a3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:30.668957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 494/980] 10.222.0.20 () {58 vars in 1059 bytes} [Fri Aug 26 00:51:30 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:51:30.677574 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd784a9-1ee5-492a-a0ff-6b6543e3a77c None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:30.692363 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd784a9-1ee5-492a-a0ff-6b6543e3a77c None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:30.698579 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270329de-27e2-4d70-851e-f94e2e4ae949 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f74984033043ecabd28df33960a37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:30.699271 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270329de-27e2-4d70-851e-f94e2e4ae949 service nova] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:30.699613 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270329de-27e2-4d70-851e-f94e2e4ae949 service nova] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:30.699952 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270329de-27e2-4d70-851e-f94e2e4ae949 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:30.708932 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270329de-27e2-4d70-851e-f94e2e4ae949 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:30.711446 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270329de-27e2-4d70-851e-f94e2e4ae949 service nova] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:30.722273 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 487/981] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:51:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:51:33.229690 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd0f1d-97f8-475f-a527-02073e4bf24c None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:33.230422 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd0f1d-97f8-475f-a527-02073e4bf24c None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:33.230422 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd0f1d-97f8-475f-a527-02073e4bf24c None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:33.231501 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 495/982] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:51:33.237793 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6193f-aed3-4822-9835-1a66bb1e7701 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:33.238540 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6193f-aed3-4822-9835-1a66bb1e7701 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:33.238947 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6193f-aed3-4822-9835-1a66bb1e7701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:33.262800 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-add6193f-aed3-4822-9835-1a66bb1e7701 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:33.264224 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-add6193f-aed3-4822-9835-1a66bb1e7701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:33.273037 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 488/983] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:51:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:51:33.628849 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd0f1d-97f8-475f-a527-02073e4bf24c None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:33.644769 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd0f1d-97f8-475f-a527-02073e4bf24c None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:33.652069 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3f706-97d6-4a67-b869-a23f36f37b6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f74984033043ecabd28df33960a37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:33.652729 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3f706-97d6-4a67-b869-a23f36f37b6f service nova] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:33.653027 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3f706-97d6-4a67-b869-a23f36f37b6f service nova] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:33.653314 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3f706-97d6-4a67-b869-a23f36f37b6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:33.662939 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3f706-97d6-4a67-b869-a23f36f37b6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:33.665153 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3f706-97d6-4a67-b869-a23f36f37b6f service nova] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:33.676036 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 496/984] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:51:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:51:36.397604 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4959df-b2a3-4929-bfbf-6cca87546664 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:36.398163 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4959df-b2a3-4929-bfbf-6cca87546664 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:36.398264 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4959df-b2a3-4929-bfbf-6cca87546664 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:36.399617 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 489/985] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:51:36.405908 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311ba3d-c37b-46fd-8ab6-6c9f9d2e5bda None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:36.406379 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311ba3d-c37b-46fd-8ab6-6c9f9d2e5bda None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:36.406617 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311ba3d-c37b-46fd-8ab6-6c9f9d2e5bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:36.428231 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-9311ba3d-c37b-46fd-8ab6-6c9f9d2e5bda None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:36.430618 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-9311ba3d-c37b-46fd-8ab6-6c9f9d2e5bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:36.439093 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 497/986] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:51:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:51:36.813534 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2c63a-d1ec-40bf-bd99-f759cdb8f2c4 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:36.814203 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2c63a-d1ec-40bf-bd99-f759cdb8f2c4 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:36.814618 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2c63a-d1ec-40bf-bd99-f759cdb8f2c4 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:36.816133 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 490/987] 10.222.0.20 () {54 vars in 962 bytes} [Fri Aug 26 00:51:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:51:36.823729 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d573e1-39a4-455f-9640-4eda64f051c8 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:36.824003 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d573e1-39a4-455f-9640-4eda64f051c8 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:36.824277 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d573e1-39a4-455f-9640-4eda64f051c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:36.847445 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-b4d573e1-39a4-455f-9640-4eda64f051c8 None None] MFA Rules not processed for user `02f74984033043ecabd28df33960a37c`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:36.848847 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-b4d573e1-39a4-455f-9640-4eda64f051c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:36.861532 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 498/988] 10.222.0.20 () {58 vars in 1059 bytes} [Fri Aug 26 00:51:36 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:51:36.869834 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2c63a-d1ec-40bf-bd99-f759cdb8f2c4 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:36.885841 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2c63a-d1ec-40bf-bd99-f759cdb8f2c4 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:36.892111 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a41d3-8c9d-4bd1-8dec-d0aa6acd38aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f74984033043ecabd28df33960a37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:36.892945 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a41d3-8c9d-4bd1-8dec-d0aa6acd38aa service nova] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:36.893422 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a41d3-8c9d-4bd1-8dec-d0aa6acd38aa service nova] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:36.893884 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a41d3-8c9d-4bd1-8dec-d0aa6acd38aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:36.904829 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a41d3-8c9d-4bd1-8dec-d0aa6acd38aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:36.906685 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a41d3-8c9d-4bd1-8dec-d0aa6acd38aa service nova] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:36.921152 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 491/989] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:51:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:51:39.528554 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb89f1-bc96-490a-a5e0-9e47233e3984 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:39.529977 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb89f1-bc96-490a-a5e0-9e47233e3984 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:39.530424 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb89f1-bc96-490a-a5e0-9e47233e3984 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:39.538120 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2982392-c9d1-4985-b103-b635f5889143 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:39.539013 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2982392-c9d1-4985-b103-b635f5889143 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:39.539447 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2982392-c9d1-4985-b103-b635f5889143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:39.542689 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 499/990] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:51:39 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:51:39.564003 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-f2982392-c9d1-4985-b103-b635f5889143 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:39.565560 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-f2982392-c9d1-4985-b103-b635f5889143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:39.581794 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 492/991] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:51:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:51:39.934557 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb89f1-bc96-490a-a5e0-9e47233e3984 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:39.950591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb89f1-bc96-490a-a5e0-9e47233e3984 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:39.956075 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e29868-a852-41ea-9f08-169d2fcd180f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f74984033043ecabd28df33960a37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:39.956937 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e29868-a852-41ea-9f08-169d2fcd180f service nova] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:39.957470 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e29868-a852-41ea-9f08-169d2fcd180f service nova] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:39.958002 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e29868-a852-41ea-9f08-169d2fcd180f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:39.967585 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e29868-a852-41ea-9f08-169d2fcd180f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:39.969756 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e29868-a852-41ea-9f08-169d2fcd180f service nova] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:39.983689 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 500/992] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:51:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:51:40.991979 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c00c0-9074-4056-9050-d594ca6a1da7 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:40.991979 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c00c0-9074-4056-9050-d594ca6a1da7 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:40.991979 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c00c0-9074-4056-9050-d594ca6a1da7 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:40.997090 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 493/993] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:51:40 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:51:41.002676 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c697747-bf44-4022-ab14-c102d5e70eef None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:41.003139 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c697747-bf44-4022-ab14-c102d5e70eef None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:41.003474 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c697747-bf44-4022-ab14-c102d5e70eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:41.048309 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-4c697747-bf44-4022-ab14-c102d5e70eef None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:41.050183 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-4c697747-bf44-4022-ab14-c102d5e70eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:41.074916 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 501/994] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:51:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:51:41.724713 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee342265-06ac-485d-a3ea-9c182219a7de None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:41.725275 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee342265-06ac-485d-a3ea-9c182219a7de None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:41.725806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee342265-06ac-485d-a3ea-9c182219a7de None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:41.727894 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 494/995] 10.222.0.20 () {54 vars in 964 bytes} [Fri Aug 26 00:51:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:51:41.733326 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a9f20-f1e3-4ef3-989b-f195e3da1239 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:41.733753 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a9f20-f1e3-4ef3-989b-f195e3da1239 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:41.734100 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a9f20-f1e3-4ef3-989b-f195e3da1239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:41.796457 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-652a9f20-f1e3-4ef3-989b-f195e3da1239 None None] MFA Rules not processed for user `85a98342482a4031b6d87cb1d0fbaea0`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:41.797798 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-652a9f20-f1e3-4ef3-989b-f195e3da1239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:41.838448 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:41.871485 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 502/996] 10.222.0.20 () {58 vars in 1061 bytes} [Fri Aug 26 00:51:41 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:51:41.878912 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee342265-06ac-485d-a3ea-9c182219a7de None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:41.891306 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee342265-06ac-485d-a3ea-9c182219a7de None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:41.895204 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c24f0-08c4-4c92-a771-7171ca3b60fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85a98342482a4031b6d87cb1d0fbaea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:41.895930 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c24f0-08c4-4c92-a771-7171ca3b60fe service cinder] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:41.896273 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c24f0-08c4-4c92-a771-7171ca3b60fe service cinder] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:41.896613 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c24f0-08c4-4c92-a771-7171ca3b60fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:41.907919 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c24f0-08c4-4c92-a771-7171ca3b60fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:41.909531 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c24f0-08c4-4c92-a771-7171ca3b60fe service cinder] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:41.921759 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 495/997] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:51:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:51:42.684012 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73692599-8771-4c43-8e21-7616c7bf6d31 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:42.684876 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73692599-8771-4c43-8e21-7616c7bf6d31 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:42.685207 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73692599-8771-4c43-8e21-7616c7bf6d31 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:42.686677 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 503/998] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:51:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:51:42.692105 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc73187-a85e-44b5-9d93-3e018d6395f6 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:42.692530 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc73187-a85e-44b5-9d93-3e018d6395f6 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:42.692649 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc73187-a85e-44b5-9d93-3e018d6395f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:42.713169 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-bfc73187-a85e-44b5-9d93-3e018d6395f6 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:42.714435 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-bfc73187-a85e-44b5-9d93-3e018d6395f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:42.722330 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 496/999] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:51:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:51:43.074670 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73692599-8771-4c43-8e21-7616c7bf6d31 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:43.090734 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73692599-8771-4c43-8e21-7616c7bf6d31 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:43.096770 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307fe69-d834-4251-84fa-6bc6338800ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f74984033043ecabd28df33960a37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:43.097800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307fe69-d834-4251-84fa-6bc6338800ec service nova] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:43.098185 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307fe69-d834-4251-84fa-6bc6338800ec service nova] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:43.098659 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307fe69-d834-4251-84fa-6bc6338800ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:43.111211 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307fe69-d834-4251-84fa-6bc6338800ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:43.113695 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307fe69-d834-4251-84fa-6bc6338800ec service nova] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:43.128181 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 504/1000] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:51:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:51:45.582578 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22e328-7998-4b00-8554-c3518d86d634 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:45.583146 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22e328-7998-4b00-8554-c3518d86d634 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:45.583146 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22e328-7998-4b00-8554-c3518d86d634 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:45.584950 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 497/1001] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:51:45.591346 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513410bd-175e-4b96-83d8-a1013d6195f8 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:45.592343 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513410bd-175e-4b96-83d8-a1013d6195f8 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:45.592806 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513410bd-175e-4b96-83d8-a1013d6195f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:45.613611 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-513410bd-175e-4b96-83d8-a1013d6195f8 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:45.616531 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-513410bd-175e-4b96-83d8-a1013d6195f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:45.637252 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 505/1002] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:51:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:51:45.995158 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22e328-7998-4b00-8554-c3518d86d634 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:46.021982 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22e328-7998-4b00-8554-c3518d86d634 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:46.027323 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513e430-5536-4770-9cb0-5734a7d56a9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f74984033043ecabd28df33960a37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:46.027936 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513e430-5536-4770-9cb0-5734a7d56a9d service nova] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:46.028213 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513e430-5536-4770-9cb0-5734a7d56a9d service nova] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:46.028482 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513e430-5536-4770-9cb0-5734a7d56a9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:46.038409 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513e430-5536-4770-9cb0-5734a7d56a9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:46.040182 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513e430-5536-4770-9cb0-5734a7d56a9d service nova] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:46.050705 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 498/1003] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:51:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:51:48.667146 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed1fe5-4446-46bc-8608-03c0027d0a7a None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:48.668016 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed1fe5-4446-46bc-8608-03c0027d0a7a None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:48.668286 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed1fe5-4446-46bc-8608-03c0027d0a7a None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:48.669939 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 506/1004] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:51:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:51:48.676186 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a91bc-b0d3-485e-9a37-f125358f5c4b None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:48.676949 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a91bc-b0d3-485e-9a37-f125358f5c4b None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:48.676949 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a91bc-b0d3-485e-9a37-f125358f5c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:48.697129 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-f61a91bc-b0d3-485e-9a37-f125358f5c4b None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:48.698372 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-f61a91bc-b0d3-485e-9a37-f125358f5c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:48.706717 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 499/1005] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:51:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:51:49.075758 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed1fe5-4446-46bc-8608-03c0027d0a7a None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:49.090964 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed1fe5-4446-46bc-8608-03c0027d0a7a None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:49.096417 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f53c7-9418-4447-a6fa-a71cba6b919c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f74984033043ecabd28df33960a37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:49.097062 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f53c7-9418-4447-a6fa-a71cba6b919c service nova] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:49.097344 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f53c7-9418-4447-a6fa-a71cba6b919c service nova] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:49.097651 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f53c7-9418-4447-a6fa-a71cba6b919c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:49.113955 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f53c7-9418-4447-a6fa-a71cba6b919c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:49.116583 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f53c7-9418-4447-a6fa-a71cba6b919c service nova] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:49.128373 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 507/1006] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:51:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:51:51.595762 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174ce8b-21c9-4365-b67a-c7709982ab63 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:51.596417 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174ce8b-21c9-4365-b67a-c7709982ab63 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:51.596417 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174ce8b-21c9-4365-b67a-c7709982ab63 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:51.597815 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 500/1007] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:51:51.607664 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e787b-d718-47fb-a9ce-781d728ce495 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:51.608257 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e787b-d718-47fb-a9ce-781d728ce495 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:51.608716 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e787b-d718-47fb-a9ce-781d728ce495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:51.635065 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-e24e787b-d718-47fb-a9ce-781d728ce495 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:51.636369 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-e24e787b-d718-47fb-a9ce-781d728ce495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:51.645038 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 508/1008] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:51:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:51:52.047639 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174ce8b-21c9-4365-b67a-c7709982ab63 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:52.071318 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174ce8b-21c9-4365-b67a-c7709982ab63 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:52.072881 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f4bff-a132-473f-a057-a72ba08c6a52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f74984033043ecabd28df33960a37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:52.073542 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f4bff-a132-473f-a057-a72ba08c6a52 service nova] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:52.073827 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f4bff-a132-473f-a057-a72ba08c6a52 service nova] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:52.074128 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f4bff-a132-473f-a057-a72ba08c6a52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:52.083310 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f4bff-a132-473f-a057-a72ba08c6a52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:52.085200 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f4bff-a132-473f-a057-a72ba08c6a52 service nova] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:52.095292 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 501/1009] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:51:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:51:56.574067 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9de17-332f-4405-b2ad-ae714278f5a1 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:56.575117 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9de17-332f-4405-b2ad-ae714278f5a1 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:56.575117 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9de17-332f-4405-b2ad-ae714278f5a1 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:56.576393 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 509/1010] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:51:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:51:56.582645 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3c446-1282-458c-af73-4817a12b437b None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:56.583276 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3c446-1282-458c-af73-4817a12b437b None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:56.583541 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3c446-1282-458c-af73-4817a12b437b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:56.595172 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=43 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:56.610459 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-30d3c446-1282-458c-af73-4817a12b437b None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:56.611917 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-30d3c446-1282-458c-af73-4817a12b437b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:56.623822 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 502/1011] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:51:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:51:56.996597 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9de17-332f-4405-b2ad-ae714278f5a1 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:57.011503 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9de17-332f-4405-b2ad-ae714278f5a1 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:57.016372 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7f9b8-9ca3-4fe5-a7a9-eb1f974dce54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f74984033043ecabd28df33960a37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:57.016966 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7f9b8-9ca3-4fe5-a7a9-eb1f974dce54 service nova] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:57.017248 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7f9b8-9ca3-4fe5-a7a9-eb1f974dce54 service nova] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:57.017584 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7f9b8-9ca3-4fe5-a7a9-eb1f974dce54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:57.029809 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7f9b8-9ca3-4fe5-a7a9-eb1f974dce54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:57.031421 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7f9b8-9ca3-4fe5-a7a9-eb1f974dce54 service nova] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:57.042993 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 510/1012] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:51:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:51:58.757224 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2a966-1222-49aa-8ed3-15cea2966d4c None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:58.757887 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2a966-1222-49aa-8ed3-15cea2966d4c None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:58.757887 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2a966-1222-49aa-8ed3-15cea2966d4c None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:58.759148 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 503/1013] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:51:58.765736 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658b838-19f9-4ffc-9d6a-6aa50b9f33b1 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:58.766267 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658b838-19f9-4ffc-9d6a-6aa50b9f33b1 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:58.766526 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658b838-19f9-4ffc-9d6a-6aa50b9f33b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:58.788131 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-a658b838-19f9-4ffc-9d6a-6aa50b9f33b1 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:58.789636 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-a658b838-19f9-4ffc-9d6a-6aa50b9f33b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:58.797641 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 511/1014] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:51:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:51:59.188265 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70f4ec-1929-410c-8ee2-3067c2a5beca None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:59.188585 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70f4ec-1929-410c-8ee2-3067c2a5beca None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:59.188809 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70f4ec-1929-410c-8ee2-3067c2a5beca None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:59.190165 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 504/1015] 10.222.0.20 () {54 vars in 967 bytes} [Fri Aug 26 00:51:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:51:59.196310 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d387a3-b53d-42f3-ae93-5ab9ef28a223 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:59.196681 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d387a3-b53d-42f3-ae93-5ab9ef28a223 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:59.197076 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d387a3-b53d-42f3-ae93-5ab9ef28a223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:59.252926 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-e3d387a3-b53d-42f3-ae93-5ab9ef28a223 None None] MFA Rules not processed for user `930b863db5db4586be6176c18a3bafd5`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:59.254227 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-e3d387a3-b53d-42f3-ae93-5ab9ef28a223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:59.319210 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 512/1016] 10.222.0.20 () {58 vars in 1064 bytes} [Fri Aug 26 00:51:59 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:51:59.326535 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70f4ec-1929-410c-8ee2-3067c2a5beca None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:59.337718 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70f4ec-1929-410c-8ee2-3067c2a5beca None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:59.341519 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8256a-e801-4cde-a154-71f5d2368a3b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930b863db5db4586be6176c18a3bafd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:59.342203 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8256a-e801-4cde-a154-71f5d2368a3b service glance] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:59.342557 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8256a-e801-4cde-a154-71f5d2368a3b service glance] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:59.342921 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8256a-e801-4cde-a154-71f5d2368a3b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:59.352336 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8256a-e801-4cde-a154-71f5d2368a3b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:59.353922 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8256a-e801-4cde-a154-71f5d2368a3b service glance] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:59.367550 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 505/1017] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:51:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:51:59.567725 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a9361-c740-461f-8cac-4764a3c4b6ea None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:59.568017 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a9361-c740-461f-8cac-4764a3c4b6ea None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:59.568622 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a9361-c740-461f-8cac-4764a3c4b6ea None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:59.570076 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 513/1018] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:51:59.575545 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f96dc-59b7-4cb2-b26c-766ac5f39977 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:59.575830 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f96dc-59b7-4cb2-b26c-766ac5f39977 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:59.576105 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f96dc-59b7-4cb2-b26c-766ac5f39977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:59.598330 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-7b6f96dc-59b7-4cb2-b26c-766ac5f39977 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:59.600262 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-7b6f96dc-59b7-4cb2-b26c-766ac5f39977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:59.608614 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 506/1019] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:51:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:51:59.961325 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a9361-c740-461f-8cac-4764a3c4b6ea None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:59.978176 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a9361-c740-461f-8cac-4764a3c4b6ea None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:59.983328 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128c3d9-a2d7-4d91-8c30-09edb9a47206 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f74984033043ecabd28df33960a37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:59.983944 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128c3d9-a2d7-4d91-8c30-09edb9a47206 service nova] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:59.984227 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128c3d9-a2d7-4d91-8c30-09edb9a47206 service nova] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:59.984502 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128c3d9-a2d7-4d91-8c30-09edb9a47206 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:59.993643 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128c3d9-a2d7-4d91-8c30-09edb9a47206 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:59.995305 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128c3d9-a2d7-4d91-8c30-09edb9a47206 service nova] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:52:00.005166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 514/1020] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:51:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:52:02.533755 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1933e-f2d2-45fa-9a26-41597f34927e None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:02.534940 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1933e-f2d2-45fa-9a26-41597f34927e None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:02.534940 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1933e-f2d2-45fa-9a26-41597f34927e None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:02.535916 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 507/1021] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:52:02.542131 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0a32d-a880-452b-8e93-e2b59a15972e None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:02.543196 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0a32d-a880-452b-8e93-e2b59a15972e None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:02.543564 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0a32d-a880-452b-8e93-e2b59a15972e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:02.564815 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-92c0a32d-a880-452b-8e93-e2b59a15972e None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:52:02.566124 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-92c0a32d-a880-452b-8e93-e2b59a15972e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:52:02.576559 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 515/1022] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:52:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:52:02.932338 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1933e-f2d2-45fa-9a26-41597f34927e None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:52:02.951004 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1933e-f2d2-45fa-9a26-41597f34927e None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:52:02.956247 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d742e-d677-4e09-812d-a6e453055bb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f74984033043ecabd28df33960a37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:52:02.956871 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d742e-d677-4e09-812d-a6e453055bb4 service nova] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:02.957151 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d742e-d677-4e09-812d-a6e453055bb4 service nova] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:02.957455 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d742e-d677-4e09-812d-a6e453055bb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:02.966986 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d742e-d677-4e09-812d-a6e453055bb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:52:02.968612 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d742e-d677-4e09-812d-a6e453055bb4 service nova] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:52:02.979739 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 508/1023] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:52:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:52:06.612643 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea051fba-8c8a-4078-b25c-1d82a5972af7 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:06.613725 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea051fba-8c8a-4078-b25c-1d82a5972af7 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:06.614016 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea051fba-8c8a-4078-b25c-1d82a5972af7 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:06.616172 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 516/1024] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:52:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:52:06.622208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f227f1-8d0b-4d0e-a464-d7839adfeb35 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:06.622831 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f227f1-8d0b-4d0e-a464-d7839adfeb35 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:06.622831 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f227f1-8d0b-4d0e-a464-d7839adfeb35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:06.643494 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-84f227f1-8d0b-4d0e-a464-d7839adfeb35 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:52:06.644765 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-84f227f1-8d0b-4d0e-a464-d7839adfeb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:52:06.656329 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 509/1025] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:52:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:52:07.017656 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea051fba-8c8a-4078-b25c-1d82a5972af7 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:52:07.033961 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea051fba-8c8a-4078-b25c-1d82a5972af7 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:52:07.040512 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e15d5b-1252-4be8-82b9-18e3b1e5b781 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f74984033043ecabd28df33960a37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:52:07.042743 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e15d5b-1252-4be8-82b9-18e3b1e5b781 service nova] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:07.042743 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e15d5b-1252-4be8-82b9-18e3b1e5b781 service nova] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:07.042743 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e15d5b-1252-4be8-82b9-18e3b1e5b781 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:07.051792 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e15d5b-1252-4be8-82b9-18e3b1e5b781 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:52:07.053856 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e15d5b-1252-4be8-82b9-18e3b1e5b781 service nova] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:52:07.066767 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 517/1026] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:52:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:52:16.637712 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=20 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:52:17.061591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=91 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:52:17.063392 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3b486-99b8-4726-b28a-5f02e7432a52 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:17.063677 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3b486-99b8-4726-b28a-5f02e7432a52 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:17.063957 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3b486-99b8-4726-b28a-5f02e7432a52 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:17.065329 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 510/1027] 10.222.0.20 () {54 vars in 918 bytes} [Fri Aug 26 00:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:52:17.071107 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05482b7e-edf7-4077-b72e-b5ae9c9577dd None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:17.074619 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05482b7e-edf7-4077-b72e-b5ae9c9577dd None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:17.074619 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05482b7e-edf7-4077-b72e-b5ae9c9577dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:17.103985 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-05482b7e-edf7-4077-b72e-b5ae9c9577dd None None] MFA Rules not processed for user `d74675b1a7a34a95b41f7f8714d47e43`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:52:17.105172 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-05482b7e-edf7-4077-b72e-b5ae9c9577dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:52:17.113899 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 518/1028] 10.222.0.20 () {58 vars in 1015 bytes} [Fri Aug 26 00:52:17 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:52:17.128539 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20c260-ea8a-4d1f-b45a-1d55379bcc8b None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:17.128828 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20c260-ea8a-4d1f-b45a-1d55379bcc8b None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:17.129110 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20c260-ea8a-4d1f-b45a-1d55379bcc8b None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:17.131329 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 511/1029] 10.222.0.20 () {54 vars in 918 bytes} [Fri Aug 26 00:52:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:52:17.136110 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3eb0bf-50f0-44bd-8a82-daf8545cb392 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:17.136393 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3eb0bf-50f0-44bd-8a82-daf8545cb392 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:17.136672 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3eb0bf-50f0-44bd-8a82-daf8545cb392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:17.156519 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-8a3eb0bf-50f0-44bd-8a82-daf8545cb392 None None] MFA Rules not processed for user `02f74984033043ecabd28df33960a37c`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:52:17.157760 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-8a3eb0bf-50f0-44bd-8a82-daf8545cb392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:52:17.166895 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 519/1030] 10.222.0.20 () {58 vars in 1015 bytes} [Fri Aug 26 00:52:17 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:52:19.915370 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a155f-99ab-47ac-aa97-d5745df35246 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:19.915982 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a155f-99ab-47ac-aa97-d5745df35246 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:19.915982 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a155f-99ab-47ac-aa97-d5745df35246 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:19.917275 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 512/1031] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:52:19.922658 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516590e-932d-4053-ac1b-a820100beeb4 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:19.923111 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516590e-932d-4053-ac1b-a820100beeb4 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:19.923209 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516590e-932d-4053-ac1b-a820100beeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:19.943138 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-8516590e-932d-4053-ac1b-a820100beeb4 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:52:19.944368 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-8516590e-932d-4053-ac1b-a820100beeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:52:19.952324 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 520/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:52:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:52:20.312875 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a155f-99ab-47ac-aa97-d5745df35246 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:52:20.328715 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a155f-99ab-47ac-aa97-d5745df35246 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:52:20.334336 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d36a8c-007e-4018-99ba-056e5d0efc0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f74984033043ecabd28df33960a37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:52:20.334951 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d36a8c-007e-4018-99ba-056e5d0efc0c service nova] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:20.335261 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d36a8c-007e-4018-99ba-056e5d0efc0c service nova] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:20.335613 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d36a8c-007e-4018-99ba-056e5d0efc0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:20.343974 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d36a8c-007e-4018-99ba-056e5d0efc0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:52:20.345601 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d36a8c-007e-4018-99ba-056e5d0efc0c service nova] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:52:20.355203 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 513/1033] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:52:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:52:21.383292 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b1449-52b1-4792-a365-a7f8d376c471 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:21.383828 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b1449-52b1-4792-a365-a7f8d376c471 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:21.383828 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b1449-52b1-4792-a365-a7f8d376c471 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:21.385115 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 521/1034] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 00:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:52:21.390279 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d032151-4e64-4518-9c26-eed463819201 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:21.390771 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d032151-4e64-4518-9c26-eed463819201 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:21.390894 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d032151-4e64-4518-9c26-eed463819201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:21.412232 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-3d032151-4e64-4518-9c26-eed463819201 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:52:21.413927 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-3d032151-4e64-4518-9c26-eed463819201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:52:21.422749 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 514/1035] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 00:52:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:52:21.683870 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b1449-52b1-4792-a365-a7f8d376c471 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:52:21.698954 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b1449-52b1-4792-a365-a7f8d376c471 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:52:21.704659 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60d486-39ab-47f0-a8d9-1adf1f75d465 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f74984033043ecabd28df33960a37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:52:21.705391 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60d486-39ab-47f0-a8d9-1adf1f75d465 service nova] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:21.705848 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60d486-39ab-47f0-a8d9-1adf1f75d465 service nova] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:21.706279 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60d486-39ab-47f0-a8d9-1adf1f75d465 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:21.716102 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e60d486-39ab-47f0-a8d9-1adf1f75d465 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:52:21.717915 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e60d486-39ab-47f0-a8d9-1adf1f75d465 service nova] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:52:21.729228 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 522/1036] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:52:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:52:22.676824 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f24432-2216-45d2-8544-8934253d4422 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:22.677429 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f24432-2216-45d2-8544-8934253d4422 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:22.677429 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f24432-2216-45d2-8544-8934253d4422 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:22.678774 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 515/1037] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 00:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:52:22.683758 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8400d-280f-46c8-9e25-681fa6adc5e1 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:22.684180 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8400d-280f-46c8-9e25-681fa6adc5e1 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:22.684323 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8400d-280f-46c8-9e25-681fa6adc5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:22.709020 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-9ed8400d-280f-46c8-9e25-681fa6adc5e1 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:52:22.710602 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-9ed8400d-280f-46c8-9e25-681fa6adc5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:52:22.718611 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 523/1038] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 00:52:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:52:22.890002 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f24432-2216-45d2-8544-8934253d4422 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:52:22.905570 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f24432-2216-45d2-8544-8934253d4422 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:52:22.911886 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb7c33-bbec-40d9-9996-0df9b3973119 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f74984033043ecabd28df33960a37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:52:22.912549 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb7c33-bbec-40d9-9996-0df9b3973119 service nova] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:22.912831 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb7c33-bbec-40d9-9996-0df9b3973119 service nova] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:22.913105 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb7c33-bbec-40d9-9996-0df9b3973119 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:22.922566 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb7c33-bbec-40d9-9996-0df9b3973119 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:52:22.924168 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb7c33-bbec-40d9-9996-0df9b3973119 service nova] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:52:22.936210 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 516/1039] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:52:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:52:23.852664 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614924c-dbb0-4bdf-b0c5-1be4d2e694f3 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:23.853245 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614924c-dbb0-4bdf-b0c5-1be4d2e694f3 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:23.853245 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614924c-dbb0-4bdf-b0c5-1be4d2e694f3 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:23.854580 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 524/1040] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 00:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:52:23.859978 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920401fb-555b-4b57-a32c-466049d7e96a None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:23.860583 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920401fb-555b-4b57-a32c-466049d7e96a None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:23.860583 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920401fb-555b-4b57-a32c-466049d7e96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:23.881353 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-920401fb-555b-4b57-a32c-466049d7e96a None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:52:23.882626 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-920401fb-555b-4b57-a32c-466049d7e96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:52:23.891426 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 517/1041] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 00:52:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:52:24.055753 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614924c-dbb0-4bdf-b0c5-1be4d2e694f3 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:52:24.070217 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614924c-dbb0-4bdf-b0c5-1be4d2e694f3 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:52:24.075292 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b8466-aa0b-42ba-9279-c1c7bedc09ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f74984033043ecabd28df33960a37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:52:24.075902 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b8466-aa0b-42ba-9279-c1c7bedc09ba service nova] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:24.076184 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b8466-aa0b-42ba-9279-c1c7bedc09ba service nova] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:24.076457 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b8466-aa0b-42ba-9279-c1c7bedc09ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:24.086108 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b8466-aa0b-42ba-9279-c1c7bedc09ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:52:24.087711 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b8466-aa0b-42ba-9279-c1c7bedc09ba service nova] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:52:24.097562 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 525/1042] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:52:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:52:24.991947 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6de54e-4e1e-4ec8-80d6-d7324c6bb24b None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:24.992492 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6de54e-4e1e-4ec8-80d6-d7324c6bb24b None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:24.992492 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6de54e-4e1e-4ec8-80d6-d7324c6bb24b None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:24.993942 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 518/1043] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 00:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:52:24.999378 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59ff20-ccbf-49c9-b448-f37e02ea84c8 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:24.999935 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59ff20-ccbf-49c9-b448-f37e02ea84c8 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:24.999935 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59ff20-ccbf-49c9-b448-f37e02ea84c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:25.022335 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-da59ff20-ccbf-49c9-b448-f37e02ea84c8 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:52:25.023523 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-da59ff20-ccbf-49c9-b448-f37e02ea84c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:52:25.031834 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 526/1044] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 00:52:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:52:25.202353 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6de54e-4e1e-4ec8-80d6-d7324c6bb24b None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:52:25.213276 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6de54e-4e1e-4ec8-80d6-d7324c6bb24b None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:52:25.218292 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c97029-9330-4090-9b94-1ec783e00040 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f74984033043ecabd28df33960a37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:52:25.218900 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c97029-9330-4090-9b94-1ec783e00040 service nova] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:25.219178 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c97029-9330-4090-9b94-1ec783e00040 service nova] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:25.219447 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c97029-9330-4090-9b94-1ec783e00040 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:25.234916 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c97029-9330-4090-9b94-1ec783e00040 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:52:25.236527 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c97029-9330-4090-9b94-1ec783e00040 service nova] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:52:25.247558 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 519/1045] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:52:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:52:26.295240 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339ccac-4dbc-462b-9acc-da8687a4a172 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:26.295768 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339ccac-4dbc-462b-9acc-da8687a4a172 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:26.295768 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339ccac-4dbc-462b-9acc-da8687a4a172 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:26.297080 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 527/1046] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 00:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:52:26.303150 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7d228-78d0-491a-908a-d49b6e0ce690 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:26.303647 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7d228-78d0-491a-908a-d49b6e0ce690 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:26.303741 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7d228-78d0-491a-908a-d49b6e0ce690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:26.324173 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-b8c7d228-78d0-491a-908a-d49b6e0ce690 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:52:26.325416 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-b8c7d228-78d0-491a-908a-d49b6e0ce690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:52:26.333709 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 520/1047] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 00:52:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:52:26.493246 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339ccac-4dbc-462b-9acc-da8687a4a172 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:52:26.507853 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339ccac-4dbc-462b-9acc-da8687a4a172 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:52:26.513261 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ce8c9-db32-4db1-a6f2-2c03612f97c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f74984033043ecabd28df33960a37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:52:26.513949 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ce8c9-db32-4db1-a6f2-2c03612f97c2 service nova] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:26.514312 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ce8c9-db32-4db1-a6f2-2c03612f97c2 service nova] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:26.514540 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ce8c9-db32-4db1-a6f2-2c03612f97c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:26.523743 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ce8c9-db32-4db1-a6f2-2c03612f97c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:52:26.525351 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ce8c9-db32-4db1-a6f2-2c03612f97c2 service nova] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:52:26.535564 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 528/1048] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:52:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:52:27.439469 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743eb86-6d3b-4c35-8181-3e6af585866a None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:27.439995 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743eb86-6d3b-4c35-8181-3e6af585866a None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:27.440091 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743eb86-6d3b-4c35-8181-3e6af585866a None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:27.441356 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 521/1049] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 00:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:52:27.446615 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c2c88-7b59-4175-83b5-698ba8043d84 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:27.447002 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c2c88-7b59-4175-83b5-698ba8043d84 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:27.447178 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c2c88-7b59-4175-83b5-698ba8043d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:27.466887 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-c80c2c88-7b59-4175-83b5-698ba8043d84 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:52:27.468112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-c80c2c88-7b59-4175-83b5-698ba8043d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:52:27.476776 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 529/1050] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 00:52:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:52:27.635726 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743eb86-6d3b-4c35-8181-3e6af585866a None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:52:27.650147 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743eb86-6d3b-4c35-8181-3e6af585866a None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:52:27.655214 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4e975-a057-4482-a26f-a909057184e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f74984033043ecabd28df33960a37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:52:27.655820 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4e975-a057-4482-a26f-a909057184e2 service nova] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:27.656107 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4e975-a057-4482-a26f-a909057184e2 service nova] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:27.656424 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4e975-a057-4482-a26f-a909057184e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:27.666005 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4e975-a057-4482-a26f-a909057184e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:52:27.667848 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4e975-a057-4482-a26f-a909057184e2 service nova] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:52:27.677668 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 522/1051] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:52:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:52:28.561641 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97d88e-c4fc-4a71-89e4-a98696b424c0 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:28.562203 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97d88e-c4fc-4a71-89e4-a98696b424c0 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:28.562203 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97d88e-c4fc-4a71-89e4-a98696b424c0 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:28.563512 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 530/1052] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 00:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:52:28.568901 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bb244-9a82-44d7-9f02-aefcb9747bd4 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:28.569338 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bb244-9a82-44d7-9f02-aefcb9747bd4 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:28.569478 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bb244-9a82-44d7-9f02-aefcb9747bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:28.588820 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-c04bb244-9a82-44d7-9f02-aefcb9747bd4 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:52:28.590069 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-c04bb244-9a82-44d7-9f02-aefcb9747bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:52:28.597971 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 523/1053] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 00:52:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:52:28.757027 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97d88e-c4fc-4a71-89e4-a98696b424c0 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:52:28.771083 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97d88e-c4fc-4a71-89e4-a98696b424c0 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:52:28.776955 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82e2d3-1959-4942-9077-3b21a15ede59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f74984033043ecabd28df33960a37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:52:28.777583 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82e2d3-1959-4942-9077-3b21a15ede59 service nova] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:28.777861 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82e2d3-1959-4942-9077-3b21a15ede59 service nova] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:28.778131 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82e2d3-1959-4942-9077-3b21a15ede59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:28.787620 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82e2d3-1959-4942-9077-3b21a15ede59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:52:28.789245 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82e2d3-1959-4942-9077-3b21a15ede59 service nova] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:52:28.799223 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 531/1054] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:52:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:52:29.670801 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4414b-5aff-4e20-a9e2-d481935e9b65 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:29.671351 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4414b-5aff-4e20-a9e2-d481935e9b65 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:29.671351 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4414b-5aff-4e20-a9e2-d481935e9b65 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:29.672690 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 524/1055] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 00:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:52:29.677618 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d20d7-7c63-49e9-b78f-1ff1623810ec None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:29.678069 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d20d7-7c63-49e9-b78f-1ff1623810ec None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:29.678166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d20d7-7c63-49e9-b78f-1ff1623810ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:29.698630 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-695d20d7-7c63-49e9-b78f-1ff1623810ec None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:52:29.699836 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-695d20d7-7c63-49e9-b78f-1ff1623810ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:52:29.707600 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 532/1056] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 00:52:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:52:29.864835 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4414b-5aff-4e20-a9e2-d481935e9b65 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:52:29.878267 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4414b-5aff-4e20-a9e2-d481935e9b65 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:52:29.884229 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8579a4b-94f1-4c27-8dc3-cc2c47db5e3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f74984033043ecabd28df33960a37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:52:29.884830 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8579a4b-94f1-4c27-8dc3-cc2c47db5e3d service nova] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:29.885137 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8579a4b-94f1-4c27-8dc3-cc2c47db5e3d service nova] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:29.885437 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8579a4b-94f1-4c27-8dc3-cc2c47db5e3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:29.893704 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8579a4b-94f1-4c27-8dc3-cc2c47db5e3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:52:29.895878 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8579a4b-94f1-4c27-8dc3-cc2c47db5e3d service nova] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:52:29.905701 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 525/1057] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:52:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:52:32.028634 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f7beb-4c80-46c9-b810-825907eb1dfb None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:32.029213 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f7beb-4c80-46c9-b810-825907eb1dfb None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:32.029213 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f7beb-4c80-46c9-b810-825907eb1dfb None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:32.030573 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 533/1058] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:52:32.036412 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e897c-f979-4bb2-bbc5-32d746b222d9 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:32.036838 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e897c-f979-4bb2-bbc5-32d746b222d9 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:32.038153 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e897c-f979-4bb2-bbc5-32d746b222d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:32.056211 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-2b7e897c-f979-4bb2-bbc5-32d746b222d9 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:52:32.057467 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-2b7e897c-f979-4bb2-bbc5-32d746b222d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:52:32.065808 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 526/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:52:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:52:32.417243 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f7beb-4c80-46c9-b810-825907eb1dfb None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:52:32.428829 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f7beb-4c80-46c9-b810-825907eb1dfb None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:52:32.432401 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc8401-2ad8-411d-b3ac-6083f14674d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:52:32.432997 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc8401-2ad8-411d-b3ac-6083f14674d5 service neutron] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:32.433277 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc8401-2ad8-411d-b3ac-6083f14674d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:32.433584 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc8401-2ad8-411d-b3ac-6083f14674d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:32.443639 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc8401-2ad8-411d-b3ac-6083f14674d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:52:32.445222 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc8401-2ad8-411d-b3ac-6083f14674d5 service neutron] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:52:32.454768 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 534/1060] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:52:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:52:34.841786 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee4c5f-c8d7-4d78-bc9b-4d092c87d412 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:34.842350 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee4c5f-c8d7-4d78-bc9b-4d092c87d412 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:34.842350 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee4c5f-c8d7-4d78-bc9b-4d092c87d412 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:34.843657 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 527/1061] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:52:34.849573 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e83d35-4448-46e4-acf6-d35e7931dbc4 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:34.850019 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e83d35-4448-46e4-acf6-d35e7931dbc4 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:34.850157 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e83d35-4448-46e4-acf6-d35e7931dbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:34.869538 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-09e83d35-4448-46e4-acf6-d35e7931dbc4 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:52:34.870769 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-09e83d35-4448-46e4-acf6-d35e7931dbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:52:34.882696 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 535/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:52:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:52:35.227000 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee4c5f-c8d7-4d78-bc9b-4d092c87d412 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:52:35.237795 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee4c5f-c8d7-4d78-bc9b-4d092c87d412 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:52:35.241552 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06708d-e119-407c-835b-97d2c5eb0dba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:52:35.242170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06708d-e119-407c-835b-97d2c5eb0dba service neutron] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:35.242457 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06708d-e119-407c-835b-97d2c5eb0dba service neutron] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:35.242736 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06708d-e119-407c-835b-97d2c5eb0dba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:35.251944 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b06708d-e119-407c-835b-97d2c5eb0dba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:52:35.253416 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b06708d-e119-407c-835b-97d2c5eb0dba service neutron] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:52:35.263522 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 528/1063] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:52:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:52:37.874013 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269b9b7-1ade-465f-b334-a2647ec790f2 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:37.874616 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269b9b7-1ade-465f-b334-a2647ec790f2 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:37.874616 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269b9b7-1ade-465f-b334-a2647ec790f2 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:37.875931 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 536/1064] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:52:37.881659 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f4acd-311b-4b7c-9595-6a9d4956b9e9 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:37.882072 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f4acd-311b-4b7c-9595-6a9d4956b9e9 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:37.882196 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f4acd-311b-4b7c-9595-6a9d4956b9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:37.901625 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-e94f4acd-311b-4b7c-9595-6a9d4956b9e9 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:52:37.902837 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-e94f4acd-311b-4b7c-9595-6a9d4956b9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:52:37.911726 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 529/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:52:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:52:38.258491 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269b9b7-1ade-465f-b334-a2647ec790f2 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:52:38.270476 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269b9b7-1ade-465f-b334-a2647ec790f2 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:52:38.274407 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0715a0f-7b58-4e12-b54d-0babbf4070a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:52:38.275004 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0715a0f-7b58-4e12-b54d-0babbf4070a9 service neutron] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:38.275286 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0715a0f-7b58-4e12-b54d-0babbf4070a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:38.275557 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0715a0f-7b58-4e12-b54d-0babbf4070a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:38.284769 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0715a0f-7b58-4e12-b54d-0babbf4070a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:52:38.287274 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0715a0f-7b58-4e12-b54d-0babbf4070a9 service neutron] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:52:38.296572 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 537/1066] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:52:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:52:40.647556 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12400c-a572-405a-a9de-94a3a30b8f17 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:40.648126 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12400c-a572-405a-a9de-94a3a30b8f17 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:40.648126 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12400c-a572-405a-a9de-94a3a30b8f17 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:40.649451 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 530/1067] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:52:40.654766 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1643db4-7df9-4454-825e-38bacdee84b5 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:40.655192 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1643db4-7df9-4454-825e-38bacdee84b5 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:40.655324 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1643db4-7df9-4454-825e-38bacdee84b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:40.677699 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-c1643db4-7df9-4454-825e-38bacdee84b5 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:52:40.678920 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-c1643db4-7df9-4454-825e-38bacdee84b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:52:40.686771 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 538/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:52:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:52:41.039342 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12400c-a572-405a-a9de-94a3a30b8f17 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:52:41.050146 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12400c-a572-405a-a9de-94a3a30b8f17 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:52:41.053747 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433978ee-5d72-4aed-ab0b-9aa2ed65d623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:52:41.054352 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433978ee-5d72-4aed-ab0b-9aa2ed65d623 service neutron] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:41.054637 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433978ee-5d72-4aed-ab0b-9aa2ed65d623 service neutron] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:41.054918 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433978ee-5d72-4aed-ab0b-9aa2ed65d623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:41.064732 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433978ee-5d72-4aed-ab0b-9aa2ed65d623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:52:41.066219 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433978ee-5d72-4aed-ab0b-9aa2ed65d623 service neutron] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:52:41.076896 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 531/1069] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:52:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:52:43.458081 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abbbb7-6420-4d43-a6b5-c07851a238f0 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:43.458617 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abbbb7-6420-4d43-a6b5-c07851a238f0 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:43.458617 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abbbb7-6420-4d43-a6b5-c07851a238f0 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:43.460096 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 539/1070] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:52:43.465714 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e7ba2-3c56-467e-913e-e3d2bdd025fd None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:43.466149 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e7ba2-3c56-467e-913e-e3d2bdd025fd None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:43.466260 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e7ba2-3c56-467e-913e-e3d2bdd025fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:43.487101 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-097e7ba2-3c56-467e-913e-e3d2bdd025fd None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:52:43.488835 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-097e7ba2-3c56-467e-913e-e3d2bdd025fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:52:43.504987 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 532/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:52:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:52:43.852769 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abbbb7-6420-4d43-a6b5-c07851a238f0 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:52:43.864251 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abbbb7-6420-4d43-a6b5-c07851a238f0 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:52:43.868031 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21191bed-34ca-4789-bd7f-4e8449bb8dfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:52:43.868627 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21191bed-34ca-4789-bd7f-4e8449bb8dfe service neutron] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:43.868903 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21191bed-34ca-4789-bd7f-4e8449bb8dfe service neutron] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:43.869172 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21191bed-34ca-4789-bd7f-4e8449bb8dfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:43.878264 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21191bed-34ca-4789-bd7f-4e8449bb8dfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:52:43.880238 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21191bed-34ca-4789-bd7f-4e8449bb8dfe service neutron] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:52:43.889719 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 540/1072] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:52:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:52:46.279857 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac5715-6a67-42ae-868e-fc503b5c6b2e None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:46.280403 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac5715-6a67-42ae-868e-fc503b5c6b2e None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:46.280403 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac5715-6a67-42ae-868e-fc503b5c6b2e None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:46.281778 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 533/1073] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:52:46.287695 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ceb31-bdee-487e-9238-6f29d10bb8d7 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:46.288103 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ceb31-bdee-487e-9238-6f29d10bb8d7 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:46.288261 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ceb31-bdee-487e-9238-6f29d10bb8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:46.307471 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-e78ceb31-bdee-487e-9238-6f29d10bb8d7 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:52:46.308672 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-e78ceb31-bdee-487e-9238-6f29d10bb8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:52:46.317142 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 541/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:52:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:52:46.678674 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac5715-6a67-42ae-868e-fc503b5c6b2e None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:52:46.690535 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac5715-6a67-42ae-868e-fc503b5c6b2e None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:52:46.694950 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe9ae2-5e37-407f-9e0c-bc73aa81c4d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:52:46.695568 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe9ae2-5e37-407f-9e0c-bc73aa81c4d2 service neutron] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:46.695854 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe9ae2-5e37-407f-9e0c-bc73aa81c4d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:46.696130 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe9ae2-5e37-407f-9e0c-bc73aa81c4d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:46.706355 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe9ae2-5e37-407f-9e0c-bc73aa81c4d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:52:46.708098 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe9ae2-5e37-407f-9e0c-bc73aa81c4d2 service neutron] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:52:46.718665 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 534/1075] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:52:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:52:49.026874 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb2481-5348-4581-a244-eeb52c7bcc50 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:49.027430 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb2481-5348-4581-a244-eeb52c7bcc50 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:49.027430 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb2481-5348-4581-a244-eeb52c7bcc50 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:49.028711 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 542/1076] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:52:49.034331 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b9d0d-015d-43ba-9ebd-38fa5a93cbc0 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:49.035438 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b9d0d-015d-43ba-9ebd-38fa5a93cbc0 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:49.035438 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b9d0d-015d-43ba-9ebd-38fa5a93cbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:49.043017 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=70 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:52:49.055687 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-e92b9d0d-015d-43ba-9ebd-38fa5a93cbc0 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:52:49.063837 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-e92b9d0d-015d-43ba-9ebd-38fa5a93cbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:52:49.064685 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 535/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:52:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:52:49.411751 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb2481-5348-4581-a244-eeb52c7bcc50 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:52:49.417157 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=78 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:52:49.422843 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb2481-5348-4581-a244-eeb52c7bcc50 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:52:49.426387 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee5119-49d5-490f-88e2-7887414175aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:52:49.429821 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee5119-49d5-490f-88e2-7887414175aa service neutron] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:49.429821 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee5119-49d5-490f-88e2-7887414175aa service neutron] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:49.429821 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee5119-49d5-490f-88e2-7887414175aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:49.436549 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee5119-49d5-490f-88e2-7887414175aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:52:49.438004 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee5119-49d5-490f-88e2-7887414175aa service neutron] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:52:49.447686 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 543/1078] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:52:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:52:51.738848 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067fac6-38f3-434e-9bea-f7a559470f2b None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:51.739532 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067fac6-38f3-434e-9bea-f7a559470f2b None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:51.739713 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067fac6-38f3-434e-9bea-f7a559470f2b None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:51.741054 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 536/1079] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:52:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:52:51.746709 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44025d-0344-4138-813c-0e2df24d3432 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:51.747232 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44025d-0344-4138-813c-0e2df24d3432 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:51.747348 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44025d-0344-4138-813c-0e2df24d3432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:51.767170 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-1e44025d-0344-4138-813c-0e2df24d3432 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:52:51.768410 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-1e44025d-0344-4138-813c-0e2df24d3432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:52:51.776585 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 544/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:52:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:52:52.124912 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067fac6-38f3-434e-9bea-f7a559470f2b None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:52:52.136021 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067fac6-38f3-434e-9bea-f7a559470f2b None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:52:52.139591 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebd17f-f5bb-449d-af71-0bb3e8a653cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:52:52.144623 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebd17f-f5bb-449d-af71-0bb3e8a653cc service neutron] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:52.144623 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebd17f-f5bb-449d-af71-0bb3e8a653cc service neutron] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:52.144623 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebd17f-f5bb-449d-af71-0bb3e8a653cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:52.149799 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ebd17f-f5bb-449d-af71-0bb3e8a653cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:52:52.151230 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ebd17f-f5bb-449d-af71-0bb3e8a653cc service neutron] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:52:52.161703 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 537/1081] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:52:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:52:54.416749 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40e2ec-7481-4e5a-855a-df099f9dd362 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:54.417303 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40e2ec-7481-4e5a-855a-df099f9dd362 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:54.417303 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40e2ec-7481-4e5a-855a-df099f9dd362 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:54.418670 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 545/1082] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:52:54.424264 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784171a-e1f7-4f56-ad86-f7173d3eaab8 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:54.424657 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784171a-e1f7-4f56-ad86-f7173d3eaab8 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:54.424859 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784171a-e1f7-4f56-ad86-f7173d3eaab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:54.445305 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-1784171a-e1f7-4f56-ad86-f7173d3eaab8 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:52:54.446568 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-1784171a-e1f7-4f56-ad86-f7173d3eaab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:52:54.454510 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 538/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:52:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:52:54.804412 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40e2ec-7481-4e5a-855a-df099f9dd362 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:52:54.815221 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40e2ec-7481-4e5a-855a-df099f9dd362 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:52:54.819544 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c00b9d-33c5-4f2a-bd98-45c166df6cda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:52:54.820142 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c00b9d-33c5-4f2a-bd98-45c166df6cda service neutron] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:54.820423 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c00b9d-33c5-4f2a-bd98-45c166df6cda service neutron] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:54.820697 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c00b9d-33c5-4f2a-bd98-45c166df6cda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:54.829673 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c00b9d-33c5-4f2a-bd98-45c166df6cda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:52:54.831104 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c00b9d-33c5-4f2a-bd98-45c166df6cda service neutron] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:52:54.841078 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 546/1084] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:52:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:52:57.075388 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85816e58-f714-4914-8dd1-0d316b492da4 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:57.076085 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85816e58-f714-4914-8dd1-0d316b492da4 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:57.076085 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85816e58-f714-4914-8dd1-0d316b492da4 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:57.077317 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 539/1085] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:52:57.083343 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed7925-9375-4fdb-93a7-530340877ee4 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:57.083770 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed7925-9375-4fdb-93a7-530340877ee4 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:57.083887 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed7925-9375-4fdb-93a7-530340877ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:57.104938 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-95ed7925-9375-4fdb-93a7-530340877ee4 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:52:57.106201 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-95ed7925-9375-4fdb-93a7-530340877ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:52:57.114443 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 547/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:52:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:52:57.462184 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85816e58-f714-4914-8dd1-0d316b492da4 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:52:57.473107 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85816e58-f714-4914-8dd1-0d316b492da4 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:52:57.476695 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a9be8-7fdc-446e-b19a-95f4ee1e93a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:52:57.477293 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a9be8-7fdc-446e-b19a-95f4ee1e93a5 service neutron] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:57.477616 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a9be8-7fdc-446e-b19a-95f4ee1e93a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:57.477895 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a9be8-7fdc-446e-b19a-95f4ee1e93a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:57.486908 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a9be8-7fdc-446e-b19a-95f4ee1e93a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:52:57.488429 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a9be8-7fdc-446e-b19a-95f4ee1e93a5 service neutron] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:52:57.497984 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 540/1087] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:52:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:53:07.099172 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=17 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:07.493879 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=17 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:23.230504 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232608a-c4b7-4ce5-9895-56008d93f298 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:23.231072 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232608a-c4b7-4ce5-9895-56008d93f298 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:23.231072 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232608a-c4b7-4ce5-9895-56008d93f298 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:23.232252 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 548/1088] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:53:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:53:23.238279 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace2e81-d9c5-445f-bff2-ae77dee40c82 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:23.238750 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace2e81-d9c5-445f-bff2-ae77dee40c82 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:23.238866 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace2e81-d9c5-445f-bff2-ae77dee40c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:23.259011 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-5ace2e81-d9c5-445f-bff2-ae77dee40c82 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:53:23.260309 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-5ace2e81-d9c5-445f-bff2-ae77dee40c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:53:23.268722 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 541/1089] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:53:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:53:23.636426 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662d1a9-dc84-4951-915e-348dff4cd4a3 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:23.640060 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662d1a9-dc84-4951-915e-348dff4cd4a3 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:23.640060 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662d1a9-dc84-4951-915e-348dff4cd4a3 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:23.640060 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 549/1090] 10.222.0.20 () {54 vars in 967 bytes} [Fri Aug 26 00:53:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:53:23.644586 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e4821-80f8-41e6-ae7a-85a0d20b15bb None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:23.644873 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e4821-80f8-41e6-ae7a-85a0d20b15bb None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:23.645160 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e4821-80f8-41e6-ae7a-85a0d20b15bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:23.668273 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-295e4821-80f8-41e6-ae7a-85a0d20b15bb None None] MFA Rules not processed for user `930b863db5db4586be6176c18a3bafd5`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:53:23.669543 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-295e4821-80f8-41e6-ae7a-85a0d20b15bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:53:23.676965 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 542/1091] 10.222.0.20 () {58 vars in 1064 bytes} [Fri Aug 26 00:53:23 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:53:23.685622 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662d1a9-dc84-4951-915e-348dff4cd4a3 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:23.697070 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662d1a9-dc84-4951-915e-348dff4cd4a3 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:23.700799 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862e6ba-2dd3-4a71-8355-2dde3bcf74eb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930b863db5db4586be6176c18a3bafd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:23.701453 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862e6ba-2dd3-4a71-8355-2dde3bcf74eb service glance] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:23.701738 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862e6ba-2dd3-4a71-8355-2dde3bcf74eb service glance] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:23.702015 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862e6ba-2dd3-4a71-8355-2dde3bcf74eb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:23.711825 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862e6ba-2dd3-4a71-8355-2dde3bcf74eb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:23.713280 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862e6ba-2dd3-4a71-8355-2dde3bcf74eb service glance] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:23.724240 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 550/1092] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:53:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:53:26.061662 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb235ed-2e2c-42f1-b4be-1e7591982abc None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:26.062194 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb235ed-2e2c-42f1-b4be-1e7591982abc None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:26.062194 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb235ed-2e2c-42f1-b4be-1e7591982abc None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:26.063466 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 543/1093] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:53:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:53:26.070784 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d20019-0cce-4d6e-be32-233f6ee6f973 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:26.071241 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d20019-0cce-4d6e-be32-233f6ee6f973 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:26.071350 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d20019-0cce-4d6e-be32-233f6ee6f973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:26.090910 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-f8d20019-0cce-4d6e-be32-233f6ee6f973 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:53:26.092121 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-f8d20019-0cce-4d6e-be32-233f6ee6f973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:53:26.100453 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 551/1094] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:53:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:53:26.435998 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb235ed-2e2c-42f1-b4be-1e7591982abc None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:26.449777 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb235ed-2e2c-42f1-b4be-1e7591982abc None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:26.454289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad2a62-bbf3-4018-bd52-3039df5c24cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:26.454882 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad2a62-bbf3-4018-bd52-3039df5c24cd admin admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:26.455168 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad2a62-bbf3-4018-bd52-3039df5c24cd admin admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:26.455471 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad2a62-bbf3-4018-bd52-3039df5c24cd admin admin] PATH_INFO: `/v3/projects` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:26.456114 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad2a62-bbf3-4018-bd52-3039df5c24cd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:26.457906 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: WARNING py.warnings [None req-04ad2a62-bbf3-4018-bd52-3039df5c24cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 00:53:26.457906 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: warnings.warn(msg) Aug 26 00:53:26.457906 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: Aug 26 00:53:26.459065 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad2a62-bbf3-4018-bd52-3039df5c24cd admin admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:26.478118 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 544/1095] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 26 00:53:26 2022] GET /identity/v3/projects => generated 1606 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:53:28.747100 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624719c3-4c15-4498-9727-14c84f9cb914 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:28.747680 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624719c3-4c15-4498-9727-14c84f9cb914 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:28.747680 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624719c3-4c15-4498-9727-14c84f9cb914 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:28.748978 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 552/1096] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:53:28.754993 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f169e-3a41-4aeb-a65b-831900ab7e44 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:28.755458 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f169e-3a41-4aeb-a65b-831900ab7e44 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:28.755562 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f169e-3a41-4aeb-a65b-831900ab7e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:28.775445 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-f28f169e-3a41-4aeb-a65b-831900ab7e44 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:53:28.776669 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-f28f169e-3a41-4aeb-a65b-831900ab7e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:53:28.785326 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 545/1097] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:53:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:53:29.157581 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624719c3-4c15-4498-9727-14c84f9cb914 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:29.171672 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624719c3-4c15-4498-9727-14c84f9cb914 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:29.177424 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591f2a8-6ca7-42cc-b58f-7f269e4fcb62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f74984033043ecabd28df33960a37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:29.178038 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591f2a8-6ca7-42cc-b58f-7f269e4fcb62 service nova] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:29.178328 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591f2a8-6ca7-42cc-b58f-7f269e4fcb62 service nova] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:29.178609 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591f2a8-6ca7-42cc-b58f-7f269e4fcb62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:29.187490 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b591f2a8-6ca7-42cc-b58f-7f269e4fcb62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:29.189089 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b591f2a8-6ca7-42cc-b58f-7f269e4fcb62 service nova] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:29.199964 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 553/1098] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:53:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:53:31.676607 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac243520-051c-4137-a813-2c983db95e4f None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:31.677189 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac243520-051c-4137-a813-2c983db95e4f None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:31.677189 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac243520-051c-4137-a813-2c983db95e4f None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:31.678522 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 546/1099] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:53:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:53:31.684374 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b585b-e188-423c-9f28-b325f6b855ed None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:31.684814 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b585b-e188-423c-9f28-b325f6b855ed None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:31.684913 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b585b-e188-423c-9f28-b325f6b855ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:31.706946 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-8d2b585b-e188-423c-9f28-b325f6b855ed None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:53:31.708222 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-8d2b585b-e188-423c-9f28-b325f6b855ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:53:31.716399 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 554/1100] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:53:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:53:32.073005 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac243520-051c-4137-a813-2c983db95e4f None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:32.084537 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac243520-051c-4137-a813-2c983db95e4f None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:32.088181 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53eb3e6-aeba-47e4-9eee-48d83636d079 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:32.088806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53eb3e6-aeba-47e4-9eee-48d83636d079 service neutron] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:32.089089 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53eb3e6-aeba-47e4-9eee-48d83636d079 service neutron] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:32.089367 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53eb3e6-aeba-47e4-9eee-48d83636d079 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:32.099475 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53eb3e6-aeba-47e4-9eee-48d83636d079 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:32.100963 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53eb3e6-aeba-47e4-9eee-48d83636d079 service neutron] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:32.110993 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 547/1101] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:53:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:53:34.378992 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388055b-64cf-4f2a-99a5-7ffbf4f6da87 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:34.379524 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388055b-64cf-4f2a-99a5-7ffbf4f6da87 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:34.379646 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388055b-64cf-4f2a-99a5-7ffbf4f6da87 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:34.380955 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 555/1102] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:53:34.386575 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bba24-0ae8-44d3-8884-084ca6c2b598 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:34.387019 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bba24-0ae8-44d3-8884-084ca6c2b598 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:34.387116 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bba24-0ae8-44d3-8884-084ca6c2b598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:34.407365 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-124bba24-0ae8-44d3-8884-084ca6c2b598 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:53:34.408818 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-124bba24-0ae8-44d3-8884-084ca6c2b598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:53:34.417081 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 548/1103] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:53:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:53:34.774008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388055b-64cf-4f2a-99a5-7ffbf4f6da87 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:34.786117 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388055b-64cf-4f2a-99a5-7ffbf4f6da87 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:34.789739 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c878742-9e4a-40f6-a754-4a99352b270a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:34.790331 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c878742-9e4a-40f6-a754-4a99352b270a service neutron] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:34.790608 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c878742-9e4a-40f6-a754-4a99352b270a service neutron] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:34.790906 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c878742-9e4a-40f6-a754-4a99352b270a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:34.801593 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c878742-9e4a-40f6-a754-4a99352b270a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:34.803034 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c878742-9e4a-40f6-a754-4a99352b270a service neutron] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:34.812772 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 556/1104] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:53:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:53:37.168655 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde3a4f-db6c-47f5-8fa1-f58e7ae05e1f None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:37.169208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde3a4f-db6c-47f5-8fa1-f58e7ae05e1f None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:37.169208 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde3a4f-db6c-47f5-8fa1-f58e7ae05e1f None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:37.170603 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 549/1105] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:53:37.176878 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcda9b7-a887-4771-904c-1f8b31a41802 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:37.177305 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcda9b7-a887-4771-904c-1f8b31a41802 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:37.177530 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcda9b7-a887-4771-904c-1f8b31a41802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:37.202715 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-8dcda9b7-a887-4771-904c-1f8b31a41802 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:53:37.202715 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-8dcda9b7-a887-4771-904c-1f8b31a41802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:53:37.206235 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 557/1106] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:53:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:53:37.582596 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde3a4f-db6c-47f5-8fa1-f58e7ae05e1f None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:37.593492 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde3a4f-db6c-47f5-8fa1-f58e7ae05e1f None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:37.601140 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a68c9-6045-44ff-a0fd-629a34554f31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:37.601831 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a68c9-6045-44ff-a0fd-629a34554f31 service neutron] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:37.614540 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a68c9-6045-44ff-a0fd-629a34554f31 service neutron] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:37.614540 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a68c9-6045-44ff-a0fd-629a34554f31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:37.614540 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a68c9-6045-44ff-a0fd-629a34554f31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:37.614540 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a68c9-6045-44ff-a0fd-629a34554f31 service neutron] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:37.623804 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 550/1107] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:53:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:53:40.291727 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea55fe-58eb-422b-bc62-b6dcc07b30aa None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:40.292262 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea55fe-58eb-422b-bc62-b6dcc07b30aa None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:40.292262 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea55fe-58eb-422b-bc62-b6dcc07b30aa None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:40.293682 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 558/1108] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 26 00:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:53:40.299815 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac2ca1-6483-4ef7-aefa-ad5c0b173147 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:40.300224 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac2ca1-6483-4ef7-aefa-ad5c0b173147 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:40.300364 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac2ca1-6483-4ef7-aefa-ad5c0b173147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:40.319496 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-87ac2ca1-6483-4ef7-aefa-ad5c0b173147 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:53:40.320715 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-87ac2ca1-6483-4ef7-aefa-ad5c0b173147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:53:40.328661 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 551/1109] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 26 00:53:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:53:40.688539 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea55fe-58eb-422b-bc62-b6dcc07b30aa None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:40.700357 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea55fe-58eb-422b-bc62-b6dcc07b30aa None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:40.703938 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05785439-44b2-4a3b-bbfe-2c6ab3ab64e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:40.704535 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05785439-44b2-4a3b-bbfe-2c6ab3ab64e5 service neutron] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:40.705309 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05785439-44b2-4a3b-bbfe-2c6ab3ab64e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:40.705622 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05785439-44b2-4a3b-bbfe-2c6ab3ab64e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:40.714701 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05785439-44b2-4a3b-bbfe-2c6ab3ab64e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:40.716212 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05785439-44b2-4a3b-bbfe-2c6ab3ab64e5 service neutron] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:40.726627 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 559/1110] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:53:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:53:50.314551 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=33 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:50.722439 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=33 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:55:10.641085 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4389d-5baf-4396-83fc-78e8c19dbf2d None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:55:10.641721 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4389d-5baf-4396-83fc-78e8c19dbf2d None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:55:10.641721 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4389d-5baf-4396-83fc-78e8c19dbf2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:55:10.662278 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-92b4389d-5baf-4396-83fc-78e8c19dbf2d None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:55:10.663525 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-92b4389d-5baf-4396-83fc-78e8c19dbf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:55:10.671631 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 552/1111] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 00:55:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:55:10.680124 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d89cc-b0bf-4d47-b9a0-0206bd732548 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:55:10.680707 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d89cc-b0bf-4d47-b9a0-0206bd732548 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:55:10.680707 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d89cc-b0bf-4d47-b9a0-0206bd732548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:55:10.701046 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-0e4d89cc-b0bf-4d47-b9a0-0206bd732548 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:55:10.702328 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-0e4d89cc-b0bf-4d47-b9a0-0206bd732548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:55:10.710186 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 560/1112] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 00:55:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:55:10.715962 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4389d-5baf-4396-83fc-78e8c19dbf2d None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:55:10.726063 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4389d-5baf-4396-83fc-78e8c19dbf2d None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:55:10.730900 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebf7f0-5087-4043-9e03-a8ba9d1d3a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:55:10.731504 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebf7f0-5087-4043-9e03-a8ba9d1d3a39 admin admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:55:10.731782 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebf7f0-5087-4043-9e03-a8ba9d1d3a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:55:10.732057 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebf7f0-5087-4043-9e03-a8ba9d1d3a39 admin admin] PATH_INFO: `/v3/domains` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:55:10.732707 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ebf7f0-5087-4043-9e03-a8ba9d1d3a39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:55:10.733007 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ebf7f0-5087-4043-9e03-a8ba9d1d3a39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:55:10.734396 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: WARNING py.warnings [None req-75ebf7f0-5087-4043-9e03-a8ba9d1d3a39 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 00:55:10.734396 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: warnings.warn(msg) Aug 26 00:55:10.734396 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: Aug 26 00:55:10.735283 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ebf7f0-5087-4043-9e03-a8ba9d1d3a39 admin admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:55:10.748020 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 553/1113] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 00:55:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:55:10.756611 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d89cc-b0bf-4d47-b9a0-0206bd732548 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:55:10.767597 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d89cc-b0bf-4d47-b9a0-0206bd732548 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:55:10.772504 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af11707-8026-4419-b007-58b148a33b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:55:10.773127 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af11707-8026-4419-b007-58b148a33b5d admin admin] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:55:10.773442 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af11707-8026-4419-b007-58b148a33b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:55:10.774338 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af11707-8026-4419-b007-58b148a33b5d admin admin] PATH_INFO: `/v3/projects` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:55:10.775471 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af11707-8026-4419-b007-58b148a33b5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:55:10.778171 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: WARNING py.warnings [None req-4af11707-8026-4419-b007-58b148a33b5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 00:55:10.778171 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: warnings.warn(msg) Aug 26 00:55:10.778171 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: Aug 26 00:55:10.780249 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af11707-8026-4419-b007-58b148a33b5d admin admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:55:10.919497 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 561/1114] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 00:55:10 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:55:10.924151 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebf7f0-5087-4043-9e03-a8ba9d1d3a39 admin admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:55:10.934757 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebf7f0-5087-4043-9e03-a8ba9d1d3a39 admin admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:55:10.999745 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d805cfc-e591-4131-bb04-02241c56cf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:55:11.000361 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d805cfc-e591-4131-bb04-02241c56cf2e admin admin] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:55:11.000643 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d805cfc-e591-4131-bb04-02241c56cf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:55:11.000982 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d805cfc-e591-4131-bb04-02241c56cf2e admin admin] PATH_INFO: `/v3/users` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:55:11.001644 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d805cfc-e591-4131-bb04-02241c56cf2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:55:11.002679 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: WARNING py.warnings [None req-5d805cfc-e591-4131-bb04-02241c56cf2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 00:55:11.002679 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: warnings.warn(msg) Aug 26 00:55:11.002679 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: Aug 26 00:55:11.003910 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d805cfc-e591-4131-bb04-02241c56cf2e admin admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:55:11.183244 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 554/1115] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 00:55:10 2022] POST /identity/v3/users => generated 289 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:55:11.187905 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af11707-8026-4419-b007-58b148a33b5d admin admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:55:11.199672 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af11707-8026-4419-b007-58b148a33b5d admin admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:55:11.204591 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036dc7e-dad2-49c9-96de-ee032abc892d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:55:11.205282 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036dc7e-dad2-49c9-96de-ee032abc892d admin admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:55:11.205605 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036dc7e-dad2-49c9-96de-ee032abc892d admin admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:55:11.205884 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036dc7e-dad2-49c9-96de-ee032abc892d admin admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:55:11.206568 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3036dc7e-dad2-49c9-96de-ee032abc892d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:55:11.207596 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: WARNING py.warnings [None req-3036dc7e-dad2-49c9-96de-ee032abc892d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 00:55:11.207596 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: warnings.warn(msg) Aug 26 00:55:11.207596 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: Aug 26 00:55:11.208519 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3036dc7e-dad2-49c9-96de-ee032abc892d admin admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:55:11.225131 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 562/1116] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 00:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:55:11.232892 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d805cfc-e591-4131-bb04-02241c56cf2e admin admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:55:11.244470 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d805cfc-e591-4131-bb04-02241c56cf2e admin admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:55:11.250431 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9dab73-95d2-4933-8583-1fb5f2d4cd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:55:11.251278 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dab73-95d2-4933-8583-1fb5f2d4cd7f admin admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:55:11.251657 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dab73-95d2-4933-8583-1fb5f2d4cd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:55:11.252082 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dab73-95d2-4933-8583-1fb5f2d4cd7f admin admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:55:11.253164 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9dab73-95d2-4933-8583-1fb5f2d4cd7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:55:11.254586 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: WARNING py.warnings [None req-5e9dab73-95d2-4933-8583-1fb5f2d4cd7f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 00:55:11.254586 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: warnings.warn(msg) Aug 26 00:55:11.254586 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: Aug 26 00:55:11.256187 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9dab73-95d2-4933-8583-1fb5f2d4cd7f admin admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:55:11.274151 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 555/1117] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 00:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:55:11.278750 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036dc7e-dad2-49c9-96de-ee032abc892d admin admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:55:11.290630 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036dc7e-dad2-49c9-96de-ee032abc892d admin admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:55:11.296097 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29839ee4-f67e-4fd9-8aad-e1d1658fffbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:55:11.296908 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29839ee4-f67e-4fd9-8aad-e1d1658fffbb admin admin] REQUEST_METHOD: `PUT` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:55:11.297296 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29839ee4-f67e-4fd9-8aad-e1d1658fffbb admin admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:55:11.297725 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29839ee4-f67e-4fd9-8aad-e1d1658fffbb admin admin] PATH_INFO: `/v3/projects/28eb86e0e0574b759dbe90105e52c739/users/285948c1f3754835b130eeefbf0b8579/roles/64e752fa5df040c1a0b12914b5dacd49` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:55:11.317691 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29839ee4-f67e-4fd9-8aad-e1d1658fffbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=28eb86e0e0574b759dbe90105e52c739, user_id=285948c1f3754835b130eeefbf0b8579, role_id=64e752fa5df040c1a0b12914b5dacd49)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:55:11.318772 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: WARNING py.warnings [None req-29839ee4-f67e-4fd9-8aad-e1d1658fffbb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 00:55:11.318772 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: warnings.warn(msg) Aug 26 00:55:11.318772 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: Aug 26 00:55:11.321802 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29839ee4-f67e-4fd9-8aad-e1d1658fffbb admin admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:55:11.460675 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 563/1118] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 00:55:11 2022] PUT /identity/v3/projects/28eb86e0e0574b759dbe90105e52c739/users/285948c1f3754835b130eeefbf0b8579/roles/64e752fa5df040c1a0b12914b5dacd49 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:55:11.474132 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36aa3e-78f8-4aa9-8819-019a5832c2a9 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:55:11.474546 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36aa3e-78f8-4aa9-8819-019a5832c2a9 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:55:11.474830 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36aa3e-78f8-4aa9-8819-019a5832c2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:55:11.506167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-7b36aa3e-78f8-4aa9-8819-019a5832c2a9 None None] MFA Rules not processed for user `285948c1f3754835b130eeefbf0b8579`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:55:11.509113 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-7b36aa3e-78f8-4aa9-8819-019a5832c2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:55:11.579522 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 556/1119] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 00:55:11 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:55:11.594348 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df223eaa-0402-499b-a8e7-def6646af532 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:55:11.594664 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df223eaa-0402-499b-a8e7-def6646af532 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:55:11.594936 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df223eaa-0402-499b-a8e7-def6646af532 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:55:11.596735 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 564/1120] 10.222.0.20 () {54 vars in 964 bytes} [Fri Aug 26 00:55:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:55:11.602284 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2603a9-e1c4-40ee-b3bd-32e2db1de9a3 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:55:11.602284 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2603a9-e1c4-40ee-b3bd-32e2db1de9a3 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:55:11.603165 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2603a9-e1c4-40ee-b3bd-32e2db1de9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:55:11.624087 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-7c2603a9-e1c4-40ee-b3bd-32e2db1de9a3 None None] MFA Rules not processed for user `85a98342482a4031b6d87cb1d0fbaea0`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:55:11.625320 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-7c2603a9-e1c4-40ee-b3bd-32e2db1de9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:55:11.685930 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:55:11.693662 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 557/1121] 10.222.0.20 () {58 vars in 1061 bytes} [Fri Aug 26 00:55:11 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:55:11.703268 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df223eaa-0402-499b-a8e7-def6646af532 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:55:11.715478 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df223eaa-0402-499b-a8e7-def6646af532 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:55:11.719178 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a6111-e4e3-4111-8b60-19c16e224aa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85a98342482a4031b6d87cb1d0fbaea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:55:11.721543 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a6111-e4e3-4111-8b60-19c16e224aa0 service cinder] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:55:11.721543 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a6111-e4e3-4111-8b60-19c16e224aa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:55:11.721543 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a6111-e4e3-4111-8b60-19c16e224aa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:55:11.739326 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a6111-e4e3-4111-8b60-19c16e224aa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:55:11.739326 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a6111-e4e3-4111-8b60-19c16e224aa0 service cinder] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:55:11.746427 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 565/1122] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:55:11 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:55:11.813732 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629f24d-b96a-4882-a8d9-486d935a6094 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:55:11.814019 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629f24d-b96a-4882-a8d9-486d935a6094 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:55:11.814300 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629f24d-b96a-4882-a8d9-486d935a6094 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:55:11.815607 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 558/1123] 10.222.0.20 () {52 vars in 830 bytes} [Fri Aug 26 00:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:55:11.819788 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a6111-e4e3-4111-8b60-19c16e224aa0 service cinder] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:55:11.898039 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a6111-e4e3-4111-8b60-19c16e224aa0 service cinder] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:55:11.903794 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688147e-97dc-4d87-97c8-75515ce59eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:55:11.904547 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688147e-97dc-4d87-97c8-75515ce59eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:55:11.905183 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688147e-97dc-4d87-97c8-75515ce59eab admin admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:55:11.905566 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688147e-97dc-4d87-97c8-75515ce59eab admin admin] PATH_INFO: `/v3/users/285948c1f3754835b130eeefbf0b8579` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:55:11.907182 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688147e-97dc-4d87-97c8-75515ce59eab admin admin] RBAC: Authorizing `identity:delete_user(user_id=285948c1f3754835b130eeefbf0b8579)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:55:11.908314 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: WARNING py.warnings [None req-a688147e-97dc-4d87-97c8-75515ce59eab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 00:55:11.908314 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: warnings.warn(msg) Aug 26 00:55:11.908314 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: Aug 26 00:55:11.909770 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688147e-97dc-4d87-97c8-75515ce59eab admin admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:55:12.389799 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [None req-a688147e-97dc-4d87-97c8-75515ce59eab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '285948c1f3754835b130eeefbf0b8579'} {{(pid=95125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:55:12.406959 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [None req-a688147e-97dc-4d87-97c8-75515ce59eab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '285948c1f3754835b130eeefbf0b8579'} {{(pid=95125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:55:12.438872 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [None req-a688147e-97dc-4d87-97c8-75515ce59eab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '285948c1f3754835b130eeefbf0b8579'} {{(pid=95125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:55:12.439907 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [None req-a688147e-97dc-4d87-97c8-75515ce59eab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '285948c1f3754835b130eeefbf0b8579'} {{(pid=95125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:55:12.445029 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:55:12.671134 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [None req-a688147e-97dc-4d87-97c8-75515ce59eab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '285948c1f3754835b130eeefbf0b8579'} {{(pid=95125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:55:12.677851 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 566/1124] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 00:55:11 2022] DELETE /identity/v3/users/285948c1f3754835b130eeefbf0b8579 => generated 0 bytes in 859 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:55:12.685733 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d38402-c5db-4300-8870-0aaf922cfab4 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:55:12.686018 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d38402-c5db-4300-8870-0aaf922cfab4 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:55:12.686583 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d38402-c5db-4300-8870-0aaf922cfab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:55:12.705936 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-73d38402-c5db-4300-8870-0aaf922cfab4 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:55:12.707198 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-73d38402-c5db-4300-8870-0aaf922cfab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:55:12.771079 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 559/1125] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 00:55:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:55:12.782273 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688147e-97dc-4d87-97c8-75515ce59eab admin admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:55:12.783783 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-a688147e-97dc-4d87-97c8-75515ce59eab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:55:12.849384 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688147e-97dc-4d87-97c8-75515ce59eab admin admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:55:12.853888 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86e080-f683-4868-89ee-3a93d112958b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:55:12.854496 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86e080-f683-4868-89ee-3a93d112958b service neutron] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:55:12.854775 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86e080-f683-4868-89ee-3a93d112958b service neutron] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:55:12.855045 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86e080-f683-4868-89ee-3a93d112958b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:55:12.864540 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86e080-f683-4868-89ee-3a93d112958b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:55:12.866024 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86e080-f683-4868-89ee-3a93d112958b service neutron] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:55:12.877267 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 567/1126] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:55:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:55:13.482461 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d38402-c5db-4300-8870-0aaf922cfab4 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:55:13.482461 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-73d38402-c5db-4300-8870-0aaf922cfab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:55:13.494099 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d38402-c5db-4300-8870-0aaf922cfab4 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:55:13.499973 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb784f-bdd3-488a-a3f2-4df16ee0512a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:55:13.500981 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb784f-bdd3-488a-a3f2-4df16ee0512a admin admin] REQUEST_METHOD: `DELETE` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:55:13.501271 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb784f-bdd3-488a-a3f2-4df16ee0512a admin admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:55:13.501588 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb784f-bdd3-488a-a3f2-4df16ee0512a admin admin] PATH_INFO: `/v3/projects/28eb86e0e0574b759dbe90105e52c739` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:55:13.502969 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb784f-bdd3-488a-a3f2-4df16ee0512a admin admin] RBAC: Authorizing `identity:delete_project(project_id=28eb86e0e0574b759dbe90105e52c739)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:55:13.504862 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: WARNING py.warnings [None req-aeeb784f-bdd3-488a-a3f2-4df16ee0512a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 00:55:13.504862 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: warnings.warn(msg) Aug 26 00:55:13.504862 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: Aug 26 00:55:13.506464 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb784f-bdd3-488a-a3f2-4df16ee0512a admin admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:55:13.736391 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [None req-aeeb784f-bdd3-488a-a3f2-4df16ee0512a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28eb86e0e0574b759dbe90105e52c739', 'request_id': 'req-aeeb784f-bdd3-488a-a3f2-4df16ee0512a'} {{(pid=95124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:55:13.742884 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [None req-aeeb784f-bdd3-488a-a3f2-4df16ee0512a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28eb86e0e0574b759dbe90105e52c739', 'request_id': 'req-aeeb784f-bdd3-488a-a3f2-4df16ee0512a'} {{(pid=95124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:55:13.758830 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [None req-aeeb784f-bdd3-488a-a3f2-4df16ee0512a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28eb86e0e0574b759dbe90105e52c739', 'request_id': 'req-aeeb784f-bdd3-488a-a3f2-4df16ee0512a'} {{(pid=95124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:55:13.871528 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [None req-aeeb784f-bdd3-488a-a3f2-4df16ee0512a admin admin] The token cache is being invalidate because project 28eb86e0e0574b759dbe90105e52c739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95124) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:55:13.871823 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [None req-aeeb784f-bdd3-488a-a3f2-4df16ee0512a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:55:13.872476 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [None req-aeeb784f-bdd3-488a-a3f2-4df16ee0512a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:55:13.874261 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 560/1127] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 00:55:13 2022] DELETE /identity/v3/projects/28eb86e0e0574b759dbe90105e52c739 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:55:22.872809 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:55:23.867813 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:56:40.116324 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466eeb8-7d3b-4c86-ac73-b37c9f1b6746 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:56:40.116916 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466eeb8-7d3b-4c86-ac73-b37c9f1b6746 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:56:40.116916 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466eeb8-7d3b-4c86-ac73-b37c9f1b6746 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:56:40.118245 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 568/1128] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 00:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:56:40.123407 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb8c6f-1899-440b-9e79-f9ce06013a08 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:56:40.130475 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb8c6f-1899-440b-9e79-f9ce06013a08 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:56:40.130475 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb8c6f-1899-440b-9e79-f9ce06013a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:56:40.143812 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-d8fb8c6f-1899-440b-9e79-f9ce06013a08 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:56:40.145033 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-d8fb8c6f-1899-440b-9e79-f9ce06013a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:56:40.207332 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 561/1129] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 00:56:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:56:40.372206 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466eeb8-7d3b-4c86-ac73-b37c9f1b6746 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:56:40.373940 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-8466eeb8-7d3b-4c86-ac73-b37c9f1b6746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:56:40.444713 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466eeb8-7d3b-4c86-ac73-b37c9f1b6746 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:56:40.449713 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16558055-f04b-4fbd-8fce-6c2f321d3fea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f74984033043ecabd28df33960a37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:56:40.450316 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16558055-f04b-4fbd-8fce-6c2f321d3fea service nova] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:56:40.450596 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16558055-f04b-4fbd-8fce-6c2f321d3fea service nova] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:56:40.450869 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16558055-f04b-4fbd-8fce-6c2f321d3fea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:56:40.459613 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16558055-f04b-4fbd-8fce-6c2f321d3fea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:56:40.461092 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16558055-f04b-4fbd-8fce-6c2f321d3fea service nova] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:56:40.470213 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 569/1130] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:56:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:56:41.314828 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2d69e-6268-4743-a2e3-0ff630ec47a7 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:56:41.315382 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2d69e-6268-4743-a2e3-0ff630ec47a7 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:56:41.315382 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2d69e-6268-4743-a2e3-0ff630ec47a7 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:56:41.316715 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 562/1131] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 00:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:56:41.321909 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d7f30-8065-4fd9-a53c-dbc7775bafab None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:56:41.322343 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d7f30-8065-4fd9-a53c-dbc7775bafab None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:56:41.322452 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d7f30-8065-4fd9-a53c-dbc7775bafab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:56:41.342945 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-615d7f30-8065-4fd9-a53c-dbc7775bafab None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:56:41.344205 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-615d7f30-8065-4fd9-a53c-dbc7775bafab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:56:41.352828 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 570/1132] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 00:56:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:56:41.517439 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2d69e-6268-4743-a2e3-0ff630ec47a7 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:56:41.531866 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2d69e-6268-4743-a2e3-0ff630ec47a7 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:56:41.538200 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef34cd9-035a-4ec2-9f3d-35651074104a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f74984033043ecabd28df33960a37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:56:41.538809 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef34cd9-035a-4ec2-9f3d-35651074104a service nova] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:56:41.539094 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef34cd9-035a-4ec2-9f3d-35651074104a service nova] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:56:41.539375 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef34cd9-035a-4ec2-9f3d-35651074104a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:56:41.547840 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef34cd9-035a-4ec2-9f3d-35651074104a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:56:41.549473 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef34cd9-035a-4ec2-9f3d-35651074104a service nova] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:56:41.559328 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 563/1133] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:56:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:56:46.228989 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ba0d9-956c-4c36-ae00-ee5a5509884b None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:56:46.229588 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ba0d9-956c-4c36-ae00-ee5a5509884b None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:56:46.229588 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ba0d9-956c-4c36-ae00-ee5a5509884b None None] PATH_INFO: `/v3` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:56:46.230841 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 571/1134] 10.222.0.17 () {54 vars in 925 bytes} [Fri Aug 26 00:56:46 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:56:46.236566 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959001c-80ee-4adf-942b-80053844103c None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:56:46.236991 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959001c-80ee-4adf-942b-80053844103c None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:56:46.237113 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959001c-80ee-4adf-942b-80053844103c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:56:46.258772 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-3959001c-80ee-4adf-942b-80053844103c None None] MFA Rules not processed for user `d74675b1a7a34a95b41f7f8714d47e43`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:56:46.259998 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-3959001c-80ee-4adf-942b-80053844103c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:56:46.323160 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 564/1135] 10.222.0.17 () {58 vars in 1015 bytes} [Fri Aug 26 00:56:46 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:56:51.018608 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34215d5-94ed-4bf6-9786-1bc76d774cec None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:56:51.019128 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34215d5-94ed-4bf6-9786-1bc76d774cec None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:56:51.019128 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34215d5-94ed-4bf6-9786-1bc76d774cec None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:56:51.020461 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 572/1136] 10.222.0.20 () {54 vars in 961 bytes} [Fri Aug 26 00:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:56:51.025967 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1495904-9792-4fc4-97c7-f2906ed1a44b None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:56:51.026413 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1495904-9792-4fc4-97c7-f2906ed1a44b None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:56:51.026517 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1495904-9792-4fc4-97c7-f2906ed1a44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:56:51.046630 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-b1495904-9792-4fc4-97c7-f2906ed1a44b None None] MFA Rules not processed for user `d74675b1a7a34a95b41f7f8714d47e43`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:56:51.047842 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-b1495904-9792-4fc4-97c7-f2906ed1a44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:56:51.056973 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 565/1137] 10.222.0.20 () {58 vars in 1058 bytes} [Fri Aug 26 00:56:51 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:56:51.064370 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34215d5-94ed-4bf6-9786-1bc76d774cec None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:56:51.078126 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34215d5-94ed-4bf6-9786-1bc76d774cec None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:56:51.083277 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e91b2-90e9-4cc1-a72a-5d120dbb11bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd74675b1a7a34a95b41f7f8714d47e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:56:51.083876 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e91b2-90e9-4cc1-a72a-5d120dbb11bf service placement] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:56:51.084735 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e91b2-90e9-4cc1-a72a-5d120dbb11bf service placement] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:56:51.085045 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e91b2-90e9-4cc1-a72a-5d120dbb11bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:56:51.093700 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e91b2-90e9-4cc1-a72a-5d120dbb11bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:56:51.095289 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e91b2-90e9-4cc1-a72a-5d120dbb11bf service placement] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:56:51.105611 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 573/1138] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:56:51 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:56:52.780272 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9ac97-f833-4ca1-9a38-9ed238160254 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:56:52.780902 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9ac97-f833-4ca1-9a38-9ed238160254 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:56:52.780902 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9ac97-f833-4ca1-9a38-9ed238160254 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:56:52.782190 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 566/1139] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 00:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:56:52.787075 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb434f8e-4555-4834-9d5a-f0895cbf2edd None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:56:52.788128 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb434f8e-4555-4834-9d5a-f0895cbf2edd None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:56:52.788432 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb434f8e-4555-4834-9d5a-f0895cbf2edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:56:52.807665 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-fb434f8e-4555-4834-9d5a-f0895cbf2edd None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:56:52.808879 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-fb434f8e-4555-4834-9d5a-f0895cbf2edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:56:52.816691 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 574/1140] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 00:56:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:56:52.975963 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9ac97-f833-4ca1-9a38-9ed238160254 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:56:52.990122 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9ac97-f833-4ca1-9a38-9ed238160254 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:56:52.995335 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306cf2ee-b560-46b2-8e9e-11e2c66057ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f74984033043ecabd28df33960a37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:56:52.995939 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cf2ee-b560-46b2-8e9e-11e2c66057ce service nova] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:56:52.996217 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cf2ee-b560-46b2-8e9e-11e2c66057ce service nova] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:56:52.996492 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cf2ee-b560-46b2-8e9e-11e2c66057ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:56:53.005083 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306cf2ee-b560-46b2-8e9e-11e2c66057ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:56:53.007580 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306cf2ee-b560-46b2-8e9e-11e2c66057ce service nova] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:56:53.017489 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 567/1141] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:56:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:56:53.849416 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e48ab-722d-4a2c-a7ab-f94b97534ccf None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:56:53.850572 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e48ab-722d-4a2c-a7ab-f94b97534ccf None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:56:53.850572 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e48ab-722d-4a2c-a7ab-f94b97534ccf None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:56:53.851942 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 575/1142] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 00:56:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:56:53.857150 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125632f-c7dc-4634-8939-7b07f53bd153 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:56:53.857606 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125632f-c7dc-4634-8939-7b07f53bd153 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:56:53.857758 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125632f-c7dc-4634-8939-7b07f53bd153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:56:53.877937 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-2125632f-c7dc-4634-8939-7b07f53bd153 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:56:53.881079 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-2125632f-c7dc-4634-8939-7b07f53bd153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:56:53.887290 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 568/1143] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 00:56:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:56:54.049667 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e48ab-722d-4a2c-a7ab-f94b97534ccf None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:56:54.064088 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e48ab-722d-4a2c-a7ab-f94b97534ccf None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:56:54.069321 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43766e24-5796-4926-8e07-a7925d2f5445 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f74984033043ecabd28df33960a37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:56:54.069962 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43766e24-5796-4926-8e07-a7925d2f5445 service nova] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:56:54.070257 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43766e24-5796-4926-8e07-a7925d2f5445 service nova] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:56:54.070520 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43766e24-5796-4926-8e07-a7925d2f5445 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:56:54.078972 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43766e24-5796-4926-8e07-a7925d2f5445 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:56:54.080553 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43766e24-5796-4926-8e07-a7925d2f5445 service nova] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:56:54.091504 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 576/1144] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:56:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:56:58.234690 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ef854-ecfe-4d33-870e-ff578a9b0e62 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:56:58.235885 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ef854-ecfe-4d33-870e-ff578a9b0e62 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:56:58.235885 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ef854-ecfe-4d33-870e-ff578a9b0e62 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:56:58.237283 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 569/1145] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:56:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:56:58.243667 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70396a4d-dc5a-4bce-b4bc-43ff260e8ab8 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:56:58.244163 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70396a4d-dc5a-4bce-b4bc-43ff260e8ab8 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:56:58.244268 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70396a4d-dc5a-4bce-b4bc-43ff260e8ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:56:58.265494 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-70396a4d-dc5a-4bce-b4bc-43ff260e8ab8 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:56:58.266737 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-70396a4d-dc5a-4bce-b4bc-43ff260e8ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:56:58.274895 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 577/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:56:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:56:58.623829 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ef854-ecfe-4d33-870e-ff578a9b0e62 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:56:58.625569 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-f22ef854-ecfe-4d33-870e-ff578a9b0e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:56:58.685755 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ef854-ecfe-4d33-870e-ff578a9b0e62 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:56:58.689299 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a0920-5750-4297-bb64-d71f68568fd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:56:58.689937 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a0920-5750-4297-bb64-d71f68568fd4 service neutron] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:56:58.690223 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a0920-5750-4297-bb64-d71f68568fd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:56:58.690500 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a0920-5750-4297-bb64-d71f68568fd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:56:58.700661 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a0920-5750-4297-bb64-d71f68568fd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:56:58.702146 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a0920-5750-4297-bb64-d71f68568fd4 service neutron] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:56:58.707350 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=100 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:56:58.712251 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 570/1147] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:56:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:57:00.916274 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a1ea9-aed5-48e9-973e-a2a0c9538b5b None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:00.916858 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a1ea9-aed5-48e9-973e-a2a0c9538b5b None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:00.916858 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a1ea9-aed5-48e9-973e-a2a0c9538b5b None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:00.918221 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 578/1148] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:57:00.924562 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195dc091-ead9-42fd-b0ce-31d612f202ab None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:00.925083 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195dc091-ead9-42fd-b0ce-31d612f202ab None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:00.925179 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195dc091-ead9-42fd-b0ce-31d612f202ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:00.947199 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-195dc091-ead9-42fd-b0ce-31d612f202ab None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:57:00.948426 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-195dc091-ead9-42fd-b0ce-31d612f202ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:00.956646 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 571/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:57:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:57:01.312041 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a1ea9-aed5-48e9-973e-a2a0c9538b5b None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:57:01.313805 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-ad3a1ea9-aed5-48e9-973e-a2a0c9538b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:01.327251 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a1ea9-aed5-48e9-973e-a2a0c9538b5b None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:57:01.332513 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63159d64-f2a5-455c-8e69-c001932aa548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:57:01.332513 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63159d64-f2a5-455c-8e69-c001932aa548 service neutron] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:01.332513 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63159d64-f2a5-455c-8e69-c001932aa548 service neutron] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:01.332513 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63159d64-f2a5-455c-8e69-c001932aa548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:01.340871 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63159d64-f2a5-455c-8e69-c001932aa548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:57:01.342356 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63159d64-f2a5-455c-8e69-c001932aa548 service neutron] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:57:01.352586 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 579/1150] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:57:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:57:05.476684 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03f27c-a308-4677-8025-dc70e6948f52 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:05.477239 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03f27c-a308-4677-8025-dc70e6948f52 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:05.477239 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03f27c-a308-4677-8025-dc70e6948f52 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:05.478618 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 572/1151] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:57:05.484145 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03578741-906a-40a6-a0f3-c0a4d2d814de None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:05.484560 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03578741-906a-40a6-a0f3-c0a4d2d814de None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:05.484688 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03578741-906a-40a6-a0f3-c0a4d2d814de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:05.492568 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=60 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:05.504629 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-03578741-906a-40a6-a0f3-c0a4d2d814de None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:57:05.506833 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-03578741-906a-40a6-a0f3-c0a4d2d814de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:05.514123 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 580/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:57:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:57:06.095883 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03f27c-a308-4677-8025-dc70e6948f52 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:57:06.097637 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-ed03f27c-a308-4677-8025-dc70e6948f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:06.156025 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03f27c-a308-4677-8025-dc70e6948f52 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:57:06.159618 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680be55-8410-4183-b711-4829594fe217 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85a98342482a4031b6d87cb1d0fbaea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:57:06.160203 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680be55-8410-4183-b711-4829594fe217 service cinder] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:06.160481 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680be55-8410-4183-b711-4829594fe217 service cinder] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:06.160750 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680be55-8410-4183-b711-4829594fe217 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:06.170492 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680be55-8410-4183-b711-4829594fe217 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:57:06.171917 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680be55-8410-4183-b711-4829594fe217 service cinder] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:57:06.182094 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 573/1153] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:57:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:57:08.447838 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ede195-1024-4543-9aa1-f69142a11aad None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:08.448427 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ede195-1024-4543-9aa1-f69142a11aad None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:08.448427 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ede195-1024-4543-9aa1-f69142a11aad None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:08.449822 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 581/1154] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:57:08.455124 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f472540-1638-4d4e-9112-4bd90390b9b9 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:08.455569 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f472540-1638-4d4e-9112-4bd90390b9b9 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:08.455666 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f472540-1638-4d4e-9112-4bd90390b9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:08.476041 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-1f472540-1638-4d4e-9112-4bd90390b9b9 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:57:08.477259 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-1f472540-1638-4d4e-9112-4bd90390b9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:08.485064 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 574/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:57:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:57:09.062023 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ede195-1024-4543-9aa1-f69142a11aad None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:57:09.063775 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-44ede195-1024-4543-9aa1-f69142a11aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:57:09.077253 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ede195-1024-4543-9aa1-f69142a11aad None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:57:09.080813 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f931bc-d781-4a85-a54b-92699a82bbe0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85a98342482a4031b6d87cb1d0fbaea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:57:09.081435 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f931bc-d781-4a85-a54b-92699a82bbe0 service cinder] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:57:09.081717 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f931bc-d781-4a85-a54b-92699a82bbe0 service cinder] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:57:09.081988 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f931bc-d781-4a85-a54b-92699a82bbe0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:57:09.091134 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f931bc-d781-4a85-a54b-92699a82bbe0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:57:09.092537 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f931bc-d781-4a85-a54b-92699a82bbe0 service cinder] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:57:09.102305 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 582/1156] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:57:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:57:18.470522 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=32 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:57:19.097714 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=8 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:26.705389 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5fb0c-365f-4690-b110-a6b230c4172a None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:26.706085 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5fb0c-365f-4690-b110-a6b230c4172a None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:26.706085 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5fb0c-365f-4690-b110-a6b230c4172a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:26.727829 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-f3d5fb0c-365f-4690-b110-a6b230c4172a None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:26.731497 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-f3d5fb0c-365f-4690-b110-a6b230c4172a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:26.741413 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 575/1157] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 00:58:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:58:26.750679 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e2789-4fcc-4d8e-90ca-4b8632346d32 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:26.751284 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e2789-4fcc-4d8e-90ca-4b8632346d32 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:26.751284 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e2789-4fcc-4d8e-90ca-4b8632346d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:26.761518 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c6847-303c-4b0d-a8ce-364c17089469 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:26.762772 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c6847-303c-4b0d-a8ce-364c17089469 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:26.762772 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c6847-303c-4b0d-a8ce-364c17089469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:26.774455 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-f50e2789-4fcc-4d8e-90ca-4b8632346d32 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:26.775811 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-f50e2789-4fcc-4d8e-90ca-4b8632346d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:26.782867 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-b25c6847-303c-4b0d-a8ce-364c17089469 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:26.784097 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-b25c6847-303c-4b0d-a8ce-364c17089469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:26.786382 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 583/1158] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 00:58:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:58:26.791368 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e2789-4fcc-4d8e-90ca-4b8632346d32 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:26.793359 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 576/1159] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 00:58:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:58:26.801818 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb798493-fd93-45ce-993e-3b7ec4c0b0df None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:26.802121 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb798493-fd93-45ce-993e-3b7ec4c0b0df None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:26.802384 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb798493-fd93-45ce-993e-3b7ec4c0b0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:26.802649 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e2789-4fcc-4d8e-90ca-4b8632346d32 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:26.808710 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf6ab8-f6ac-4282-8036-9c99160687d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:26.809336 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf6ab8-f6ac-4282-8036-9c99160687d4 admin admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:26.809660 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf6ab8-f6ac-4282-8036-9c99160687d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:26.809958 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf6ab8-f6ac-4282-8036-9c99160687d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:26.810618 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf6ab8-f6ac-4282-8036-9c99160687d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:58:26.810927 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf6ab8-f6ac-4282-8036-9c99160687d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:26.812080 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: WARNING py.warnings [None req-9fbf6ab8-f6ac-4282-8036-9c99160687d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 00:58:26.812080 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: warnings.warn(msg) Aug 26 00:58:26.812080 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: Aug 26 00:58:26.813747 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf6ab8-f6ac-4282-8036-9c99160687d4 admin admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:26.824986 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-cb798493-fd93-45ce-993e-3b7ec4c0b0df None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:26.826282 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-cb798493-fd93-45ce-993e-3b7ec4c0b0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:26.829638 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 584/1160] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 00:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:58:26.835730 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 577/1161] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 00:58:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:58:26.838928 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf6ab8-f6ac-4282-8036-9c99160687d4 admin admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:26.840992 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb798493-fd93-45ce-993e-3b7ec4c0b0df None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:26.849361 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf6ab8-f6ac-4282-8036-9c99160687d4 admin admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:26.854223 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb798493-fd93-45ce-993e-3b7ec4c0b0df None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:26.855119 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedc487-8fae-4394-838f-243e8f62d64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:26.855766 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedc487-8fae-4394-838f-243e8f62d64f admin admin] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:26.856049 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedc487-8fae-4394-838f-243e8f62d64f admin admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:26.856325 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedc487-8fae-4394-838f-243e8f62d64f admin admin] PATH_INFO: `/v3/projects` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:26.856962 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfedc487-8fae-4394-838f-243e8f62d64f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:26.859125 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfedc487-8fae-4394-838f-243e8f62d64f admin admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:26.859253 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c2173-15d7-47ac-a124-a7597c804518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:26.859902 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c2173-15d7-47ac-a124-a7597c804518 admin admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:26.860171 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c2173-15d7-47ac-a124-a7597c804518 admin admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:26.860445 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c2173-15d7-47ac-a124-a7597c804518 admin admin] PATH_INFO: `/v3/domains` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:26.861441 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c2173-15d7-47ac-a124-a7597c804518 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=95124) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:58:26.861961 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c2173-15d7-47ac-a124-a7597c804518 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:26.863772 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c2173-15d7-47ac-a124-a7597c804518 admin admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:26.880027 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 578/1162] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 26 00:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:58:26.887709 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c2173-15d7-47ac-a124-a7597c804518 admin admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:26.898389 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c2173-15d7-47ac-a124-a7597c804518 admin admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:26.903602 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63459573-4c3a-4b35-b6d4-eb93b10fe869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:26.904213 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63459573-4c3a-4b35-b6d4-eb93b10fe869 admin admin] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:26.904495 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63459573-4c3a-4b35-b6d4-eb93b10fe869 admin admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:26.904776 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63459573-4c3a-4b35-b6d4-eb93b10fe869 admin admin] PATH_INFO: `/v3/projects` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:26.905434 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63459573-4c3a-4b35-b6d4-eb93b10fe869 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:26.906489 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: WARNING py.warnings [None req-63459573-4c3a-4b35-b6d4-eb93b10fe869 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 00:58:26.906489 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: warnings.warn(msg) Aug 26 00:58:26.906489 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: Aug 26 00:58:26.907748 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63459573-4c3a-4b35-b6d4-eb93b10fe869 admin admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:26.966418 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 585/1163] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 00:58:26 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:58:26.967411 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedc487-8fae-4394-838f-243e8f62d64f admin admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:27.031035 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 579/1164] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 00:58:26 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:58:27.034218 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedc487-8fae-4394-838f-243e8f62d64f admin admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:27.037301 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63459573-4c3a-4b35-b6d4-eb93b10fe869 admin admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:27.095447 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf965a-954b-4b92-b662-77b81f1824c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:27.096076 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf965a-954b-4b92-b662-77b81f1824c2 admin admin] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:27.096366 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf965a-954b-4b92-b662-77b81f1824c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:27.096644 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf965a-954b-4b92-b662-77b81f1824c2 admin admin] PATH_INFO: `/v3/users` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:27.097324 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf965a-954b-4b92-b662-77b81f1824c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:27.098496 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: WARNING py.warnings [None req-0acf965a-954b-4b92-b662-77b81f1824c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 00:58:27.098496 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: warnings.warn(msg) Aug 26 00:58:27.098496 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: Aug 26 00:58:27.099729 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf965a-954b-4b92-b662-77b81f1824c2 admin admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:27.111032 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63459573-4c3a-4b35-b6d4-eb93b10fe869 admin admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:27.115991 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37456bc-0b9a-4aaf-87d7-740d1cf0d0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:27.116614 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37456bc-0b9a-4aaf-87d7-740d1cf0d0ff admin admin] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:27.116898 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37456bc-0b9a-4aaf-87d7-740d1cf0d0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:27.117281 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37456bc-0b9a-4aaf-87d7-740d1cf0d0ff admin admin] PATH_INFO: `/v3/users` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:27.120638 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37456bc-0b9a-4aaf-87d7-740d1cf0d0ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:27.120638 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37456bc-0b9a-4aaf-87d7-740d1cf0d0ff admin admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:27.223263 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 586/1165] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 00:58:26 2022] POST /identity/v3/users => generated 293 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:58:27.227154 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf965a-954b-4b92-b662-77b81f1824c2 admin admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:27.237783 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf965a-954b-4b92-b662-77b81f1824c2 admin admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:27.242901 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778791a-32d4-43b9-98d4-138349beedc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:27.243506 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778791a-32d4-43b9-98d4-138349beedc5 admin admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:27.245031 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778791a-32d4-43b9-98d4-138349beedc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:27.245031 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778791a-32d4-43b9-98d4-138349beedc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:27.245393 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778791a-32d4-43b9-98d4-138349beedc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:27.247027 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778791a-32d4-43b9-98d4-138349beedc5 admin admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:27.258176 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 587/1166] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 00:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:58:27.258463 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 580/1167] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 00:58:27 2022] POST /identity/v3/users => generated 290 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:58:27.266329 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778791a-32d4-43b9-98d4-138349beedc5 admin admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:27.266506 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37456bc-0b9a-4aaf-87d7-740d1cf0d0ff admin admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:27.277670 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778791a-32d4-43b9-98d4-138349beedc5 admin admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:27.278162 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37456bc-0b9a-4aaf-87d7-740d1cf0d0ff admin admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:27.282785 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c04c57-3732-45b9-8618-9b0f1aae7241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:27.283043 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3446d-0f53-4e73-b43e-7e2297d1863e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:27.283395 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c04c57-3732-45b9-8618-9b0f1aae7241 admin admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:27.283660 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3446d-0f53-4e73-b43e-7e2297d1863e admin admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:27.283832 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c04c57-3732-45b9-8618-9b0f1aae7241 admin admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:27.283948 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3446d-0f53-4e73-b43e-7e2297d1863e admin admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:27.284031 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c04c57-3732-45b9-8618-9b0f1aae7241 admin admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:27.284209 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3446d-0f53-4e73-b43e-7e2297d1863e admin admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:27.284631 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c04c57-3732-45b9-8618-9b0f1aae7241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:27.284857 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea3446d-0f53-4e73-b43e-7e2297d1863e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:27.294554 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c04c57-3732-45b9-8618-9b0f1aae7241 admin admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:27.294654 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea3446d-0f53-4e73-b43e-7e2297d1863e admin admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:27.297753 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 581/1168] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 00:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:58:27.301622 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 588/1169] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 00:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:58:27.301883 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3446d-0f53-4e73-b43e-7e2297d1863e admin admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:27.302673 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c04c57-3732-45b9-8618-9b0f1aae7241 admin admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:27.312069 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3446d-0f53-4e73-b43e-7e2297d1863e admin admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:27.312443 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c04c57-3732-45b9-8618-9b0f1aae7241 admin admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:27.316778 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade89c8-f443-4e25-b5ae-501926f195ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:27.317210 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61fb8c-8650-4069-a752-c15079cc17df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:27.317400 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade89c8-f443-4e25-b5ae-501926f195ea admin admin] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:27.317677 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade89c8-f443-4e25-b5ae-501926f195ea admin admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:27.317829 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61fb8c-8650-4069-a752-c15079cc17df admin admin] REQUEST_METHOD: `PUT` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:27.317951 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade89c8-f443-4e25-b5ae-501926f195ea admin admin] PATH_INFO: `/v3/roles` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:27.318110 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61fb8c-8650-4069-a752-c15079cc17df admin admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:27.318386 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61fb8c-8650-4069-a752-c15079cc17df admin admin] PATH_INFO: `/v3/projects/2cf8f9decaf34b8da82724b855c2a982/users/55abc026ec1d47eca664bb9e9532ec8f/roles/64e752fa5df040c1a0b12914b5dacd49` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:27.318602 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade89c8-f443-4e25-b5ae-501926f195ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:27.320279 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade89c8-f443-4e25-b5ae-501926f195ea admin admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:27.331139 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 582/1170] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 00:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:58:27.335343 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61fb8c-8650-4069-a752-c15079cc17df admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cf8f9decaf34b8da82724b855c2a982, user_id=55abc026ec1d47eca664bb9e9532ec8f, role_id=64e752fa5df040c1a0b12914b5dacd49)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:27.335546 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade89c8-f443-4e25-b5ae-501926f195ea admin admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:27.338784 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61fb8c-8650-4069-a752-c15079cc17df admin admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:27.346702 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade89c8-f443-4e25-b5ae-501926f195ea admin admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:27.351674 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a81d6-1934-4fe8-8c15-86254098432c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:27.352351 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a81d6-1934-4fe8-8c15-86254098432c admin admin] REQUEST_METHOD: `PUT` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:27.352673 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a81d6-1934-4fe8-8c15-86254098432c admin admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:27.352955 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a81d6-1934-4fe8-8c15-86254098432c admin admin] PATH_INFO: `/v3/projects/11afc4d3c62b4f83a9af8f5375b18add/users/fb9c3d14579149b98917e7d099daa924/roles/64e752fa5df040c1a0b12914b5dacd49` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:27.368526 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a81d6-1934-4fe8-8c15-86254098432c admin admin] RBAC: Authorizing `identity:create_grant(project_id=11afc4d3c62b4f83a9af8f5375b18add, user_id=fb9c3d14579149b98917e7d099daa924, role_id=64e752fa5df040c1a0b12914b5dacd49)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:27.369622 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: WARNING py.warnings [None req-c13a81d6-1934-4fe8-8c15-86254098432c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 00:58:27.369622 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: warnings.warn(msg) Aug 26 00:58:27.369622 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: Aug 26 00:58:27.371703 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a81d6-1934-4fe8-8c15-86254098432c admin admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:27.452519 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 589/1171] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 00:58:27 2022] PUT /identity/v3/projects/2cf8f9decaf34b8da82724b855c2a982/users/55abc026ec1d47eca664bb9e9532ec8f/roles/64e752fa5df040c1a0b12914b5dacd49 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:58:27.457843 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde8239-34e6-425d-95e8-121de40c84c8 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:27.458135 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde8239-34e6-425d-95e8-121de40c84c8 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:27.458409 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde8239-34e6-425d-95e8-121de40c84c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:27.478173 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-ccde8239-34e6-425d-95e8-121de40c84c8 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:27.480763 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-ccde8239-34e6-425d-95e8-121de40c84c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:27.487099 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 583/1172] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 00:58:27 2022] PUT /identity/v3/projects/11afc4d3c62b4f83a9af8f5375b18add/users/fb9c3d14579149b98917e7d099daa924/roles/64e752fa5df040c1a0b12914b5dacd49 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:58:27.490126 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:27.492149 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928c0f6-4973-4cfe-b971-ff302b5d6733 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:27.492439 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928c0f6-4973-4cfe-b971-ff302b5d6733 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:27.492711 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928c0f6-4973-4cfe-b971-ff302b5d6733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:27.512568 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-0928c0f6-4973-4cfe-b971-ff302b5d6733 None None] MFA Rules not processed for user `a681f7ed1c9344b28a9297878afcbf46`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:27.514430 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-0928c0f6-4973-4cfe-b971-ff302b5d6733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:27.552677 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 590/1173] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 00:58:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:58:27.562442 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:27.563093 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde8239-34e6-425d-95e8-121de40c84c8 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:27.579141 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 584/1174] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 00:58:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:58:27.590759 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928c0f6-4973-4cfe-b971-ff302b5d6733 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:27.620257 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde8239-34e6-425d-95e8-121de40c84c8 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:27.624184 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811bfef-5bb8-49c7-a983-0e1687eeab93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:27.624831 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811bfef-5bb8-49c7-a983-0e1687eeab93 service neutron] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:27.625185 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811bfef-5bb8-49c7-a983-0e1687eeab93 service neutron] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:27.625513 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811bfef-5bb8-49c7-a983-0e1687eeab93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:27.635628 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811bfef-5bb8-49c7-a983-0e1687eeab93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:27.637085 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811bfef-5bb8-49c7-a983-0e1687eeab93 service neutron] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:27.646635 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928c0f6-4973-4cfe-b971-ff302b5d6733 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:27.648729 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 591/1175] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:58:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:58:27.651774 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11070d9e-2b21-4505-a3e4-0406b6f93893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:27.652660 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11070d9e-2b21-4505-a3e4-0406b6f93893 service neutron] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:27.652936 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11070d9e-2b21-4505-a3e4-0406b6f93893 service neutron] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:27.653210 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11070d9e-2b21-4505-a3e4-0406b6f93893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:27.662919 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11070d9e-2b21-4505-a3e4-0406b6f93893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:27.664362 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11070d9e-2b21-4505-a3e4-0406b6f93893 service neutron] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:27.675375 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 585/1176] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:58:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:58:35.235421 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8eafd-a676-4a09-9c67-471dce0e10a5 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:35.236125 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8eafd-a676-4a09-9c67-471dce0e10a5 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:35.236283 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8eafd-a676-4a09-9c67-471dce0e10a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:35.290035 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-7bf8eafd-a676-4a09-9c67-471dce0e10a5 None None] MFA Rules not processed for user `55abc026ec1d47eca664bb9e9532ec8f`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:35.292381 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-7bf8eafd-a676-4a09-9c67-471dce0e10a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:35.438027 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 592/1177] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 00:58:35 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:58:35.442399 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11070d9e-2b21-4505-a3e4-0406b6f93893 service neutron] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:35.459428 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11070d9e-2b21-4505-a3e4-0406b6f93893 service neutron] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:35.466667 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb46bee2-67d7-4eac-89b9-3f8ee251cb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:35.467891 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46bee2-67d7-4eac-89b9-3f8ee251cb59 admin admin] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:35.471014 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46bee2-67d7-4eac-89b9-3f8ee251cb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:35.471014 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46bee2-67d7-4eac-89b9-3f8ee251cb59 admin admin] PATH_INFO: `/v3/projects` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:35.471014 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb46bee2-67d7-4eac-89b9-3f8ee251cb59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:35.472671 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb46bee2-67d7-4eac-89b9-3f8ee251cb59 admin admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:35.596057 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 586/1178] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 00:58:35 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:58:35.600281 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8eafd-a676-4a09-9c67-471dce0e10a5 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:35.618001 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8eafd-a676-4a09-9c67-471dce0e10a5 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:35.686414 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:35.714273 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497aca2e-c405-4ab2-8eb9-d52137dfa9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:35.715059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497aca2e-c405-4ab2-8eb9-d52137dfa9c3 admin admin] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:35.715507 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497aca2e-c405-4ab2-8eb9-d52137dfa9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:35.715862 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497aca2e-c405-4ab2-8eb9-d52137dfa9c3 admin admin] PATH_INFO: `/v3/users` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:35.716593 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497aca2e-c405-4ab2-8eb9-d52137dfa9c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:35.718746 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497aca2e-c405-4ab2-8eb9-d52137dfa9c3 admin admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:35.872711 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8b476-6985-48c3-9a7e-ac30fe7d5cea None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:35.873005 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8b476-6985-48c3-9a7e-ac30fe7d5cea None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:35.873286 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8b476-6985-48c3-9a7e-ac30fe7d5cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:35.917442 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 593/1179] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 00:58:35 2022] POST /identity/v3/users => generated 299 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:58:35.921278 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497aca2e-c405-4ab2-8eb9-d52137dfa9c3 admin admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:35.921624 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-6ac8b476-6985-48c3-9a7e-ac30fe7d5cea None None] MFA Rules not processed for user `fb9c3d14579149b98917e7d099daa924`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:35.923833 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-6ac8b476-6985-48c3-9a7e-ac30fe7d5cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:35.938135 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497aca2e-c405-4ab2-8eb9-d52137dfa9c3 admin admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:35.980831 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e67a9-1008-4031-9946-83ffeaf4ea4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:35.981675 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e67a9-1008-4031-9946-83ffeaf4ea4f admin admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:35.982032 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e67a9-1008-4031-9946-83ffeaf4ea4f admin admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:35.982381 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e67a9-1008-4031-9946-83ffeaf4ea4f admin admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:35.983128 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e67a9-1008-4031-9946-83ffeaf4ea4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:35.984752 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e67a9-1008-4031-9946-83ffeaf4ea4f admin admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:35.996422 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 594/1180] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 00:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:58:36.000532 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e67a9-1008-4031-9946-83ffeaf4ea4f admin admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:36.017662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e67a9-1008-4031-9946-83ffeaf4ea4f admin admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:36.044231 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c171cbb-a9ce-4e84-b929-02ab04839025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:36.045423 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c171cbb-a9ce-4e84-b929-02ab04839025 admin admin] REQUEST_METHOD: `PUT` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:36.045559 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 587/1181] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 00:58:35 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:58:36.045671 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c171cbb-a9ce-4e84-b929-02ab04839025 admin admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:36.045671 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c171cbb-a9ce-4e84-b929-02ab04839025 admin admin] PATH_INFO: `/v3/projects/296e0ab05c4a42ae8c647c6974aaf349/users/dfeb8fa3a8834464a31953bdb5958318/roles/f13055bcebf847bf8b46160ded13810b` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:36.049571 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8b476-6985-48c3-9a7e-ac30fe7d5cea None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:36.062098 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8b476-6985-48c3-9a7e-ac30fe7d5cea None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:36.063453 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c171cbb-a9ce-4e84-b929-02ab04839025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=296e0ab05c4a42ae8c647c6974aaf349, user_id=dfeb8fa3a8834464a31953bdb5958318, role_id=f13055bcebf847bf8b46160ded13810b)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:36.066216 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c171cbb-a9ce-4e84-b929-02ab04839025 admin admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:36.067347 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94d0ea-f5f6-4a08-b24f-9cc4b202a2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:36.068074 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94d0ea-f5f6-4a08-b24f-9cc4b202a2ea admin admin] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:36.068455 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94d0ea-f5f6-4a08-b24f-9cc4b202a2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:36.069069 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94d0ea-f5f6-4a08-b24f-9cc4b202a2ea admin admin] PATH_INFO: `/v3/projects` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:36.069822 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94d0ea-f5f6-4a08-b24f-9cc4b202a2ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:36.077784 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94d0ea-f5f6-4a08-b24f-9cc4b202a2ea admin admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:36.230868 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 595/1182] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 00:58:35 2022] PUT /identity/v3/projects/296e0ab05c4a42ae8c647c6974aaf349/users/dfeb8fa3a8834464a31953bdb5958318/roles/f13055bcebf847bf8b46160ded13810b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:58:36.235096 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c171cbb-a9ce-4e84-b929-02ab04839025 admin admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:36.247636 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 588/1183] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 26 00:58:36 2022] POST /identity/v3/projects => generated 377 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:58:36.249616 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94d0ea-f5f6-4a08-b24f-9cc4b202a2ea admin admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:36.302262 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:36.318807 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c171cbb-a9ce-4e84-b929-02ab04839025 admin admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:36.325822 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05e310-857f-4e19-ac75-e241cb4f0532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:36.326218 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94d0ea-f5f6-4a08-b24f-9cc4b202a2ea admin admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:36.327358 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05e310-857f-4e19-ac75-e241cb4f0532 admin admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:36.327962 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05e310-857f-4e19-ac75-e241cb4f0532 admin admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:36.328518 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05e310-857f-4e19-ac75-e241cb4f0532 admin admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:36.329344 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05e310-857f-4e19-ac75-e241cb4f0532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:36.332806 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05e310-857f-4e19-ac75-e241cb4f0532 admin admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:36.339397 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a336f4-3634-400a-9c69-e713e71b5f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:36.340209 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a336f4-3634-400a-9c69-e713e71b5f14 admin admin] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:36.340503 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a336f4-3634-400a-9c69-e713e71b5f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:36.340869 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a336f4-3634-400a-9c69-e713e71b5f14 admin admin] PATH_INFO: `/v3/users` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:36.341468 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a336f4-3634-400a-9c69-e713e71b5f14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:36.343461 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a336f4-3634-400a-9c69-e713e71b5f14 admin admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:36.347716 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 596/1184] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 00:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:58:36.357630 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05e310-857f-4e19-ac75-e241cb4f0532 admin admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:36.369131 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05e310-857f-4e19-ac75-e241cb4f0532 admin admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:36.374092 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b81d21-b5bc-4e20-963d-0f31a6f69eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:36.374787 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b81d21-b5bc-4e20-963d-0f31a6f69eed admin admin] REQUEST_METHOD: `PUT` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:36.375066 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b81d21-b5bc-4e20-963d-0f31a6f69eed admin admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:36.375338 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b81d21-b5bc-4e20-963d-0f31a6f69eed admin admin] PATH_INFO: `/v3/projects/296e0ab05c4a42ae8c647c6974aaf349/users/dfeb8fa3a8834464a31953bdb5958318/roles/f13055bcebf847bf8b46160ded13810b` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:36.377309 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b81d21-b5bc-4e20-963d-0f31a6f69eed admin admin] RBAC: Authorizing `identity:create_grant(project_id=296e0ab05c4a42ae8c647c6974aaf349, user_id=dfeb8fa3a8834464a31953bdb5958318, role_id=f13055bcebf847bf8b46160ded13810b)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:36.380032 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b81d21-b5bc-4e20-963d-0f31a6f69eed admin admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:36.392404 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 597/1185] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 00:58:36 2022] PUT /identity/v3/projects/296e0ab05c4a42ae8c647c6974aaf349/users/dfeb8fa3a8834464a31953bdb5958318/roles/f13055bcebf847bf8b46160ded13810b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:58:36.446537 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 589/1186] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 26 00:58:36 2022] POST /identity/v3/users => generated 295 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:58:36.451369 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b81d21-b5bc-4e20-963d-0f31a6f69eed admin admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:36.534865 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b81d21-b5bc-4e20-963d-0f31a6f69eed admin admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:36.540095 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0663b2-3351-48b5-8b40-eb1018fdc8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:36.540774 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0663b2-3351-48b5-8b40-eb1018fdc8cc admin admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:36.541628 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0663b2-3351-48b5-8b40-eb1018fdc8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:36.541908 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0663b2-3351-48b5-8b40-eb1018fdc8cc admin admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:36.542567 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0663b2-3351-48b5-8b40-eb1018fdc8cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:36.544204 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0663b2-3351-48b5-8b40-eb1018fdc8cc admin admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:36.555743 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 598/1187] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 00:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:58:36.559975 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a336f4-3634-400a-9c69-e713e71b5f14 admin admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:36.573045 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a336f4-3634-400a-9c69-e713e71b5f14 admin admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:36.578966 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1926fa-8dd3-44e6-b704-31f1f1e916cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:36.580167 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1926fa-8dd3-44e6-b704-31f1f1e916cd admin admin] REQUEST_METHOD: `PUT` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:36.580623 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1926fa-8dd3-44e6-b704-31f1f1e916cd admin admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:36.581922 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1926fa-8dd3-44e6-b704-31f1f1e916cd admin admin] PATH_INFO: `/v3/projects/53a464e8da814116a60eea81edd1e1ac/users/30da4a0a6371411b8a6b60791ff88416/roles/f13055bcebf847bf8b46160ded13810b` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:36.615864 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1926fa-8dd3-44e6-b704-31f1f1e916cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=53a464e8da814116a60eea81edd1e1ac, user_id=30da4a0a6371411b8a6b60791ff88416, role_id=f13055bcebf847bf8b46160ded13810b)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:36.615864 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1926fa-8dd3-44e6-b704-31f1f1e916cd admin admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:36.760912 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 590/1188] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 00:58:36 2022] PUT /identity/v3/projects/53a464e8da814116a60eea81edd1e1ac/users/30da4a0a6371411b8a6b60791ff88416/roles/f13055bcebf847bf8b46160ded13810b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:58:36.765195 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0663b2-3351-48b5-8b40-eb1018fdc8cc admin admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:36.776408 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0663b2-3351-48b5-8b40-eb1018fdc8cc admin admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:36.788895 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:36.841662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e4a75-fa69-4678-a9b7-625115756176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:36.842291 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e4a75-fa69-4678-a9b7-625115756176 admin admin] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:36.842577 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e4a75-fa69-4678-a9b7-625115756176 admin admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:36.842860 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e4a75-fa69-4678-a9b7-625115756176 admin admin] PATH_INFO: `/v3/roles` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:36.843519 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e4a75-fa69-4678-a9b7-625115756176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:36.845279 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e4a75-fa69-4678-a9b7-625115756176 admin admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:36.859295 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 599/1189] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 26 00:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:58:36.863454 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1926fa-8dd3-44e6-b704-31f1f1e916cd admin admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:36.875741 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1926fa-8dd3-44e6-b704-31f1f1e916cd admin admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:36.898298 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705c3c0-d5a7-434c-9f8e-65b0d63d60e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:36.898997 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705c3c0-d5a7-434c-9f8e-65b0d63d60e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:36.899286 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705c3c0-d5a7-434c-9f8e-65b0d63d60e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:36.899571 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705c3c0-d5a7-434c-9f8e-65b0d63d60e2 admin admin] PATH_INFO: `/v3/projects/53a464e8da814116a60eea81edd1e1ac/users/30da4a0a6371411b8a6b60791ff88416/roles/f13055bcebf847bf8b46160ded13810b` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:36.904382 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705c3c0-d5a7-434c-9f8e-65b0d63d60e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53a464e8da814116a60eea81edd1e1ac, user_id=30da4a0a6371411b8a6b60791ff88416, role_id=f13055bcebf847bf8b46160ded13810b)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:36.907314 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705c3c0-d5a7-434c-9f8e-65b0d63d60e2 admin admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:36.921461 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 591/1190] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 26 00:58:36 2022] PUT /identity/v3/projects/53a464e8da814116a60eea81edd1e1ac/users/30da4a0a6371411b8a6b60791ff88416/roles/f13055bcebf847bf8b46160ded13810b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:58:44.485760 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71202845-37e6-4966-9077-baba3364c6b5 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:44.486280 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71202845-37e6-4966-9077-baba3364c6b5 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:44.486421 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71202845-37e6-4966-9077-baba3364c6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:44.523065 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-71202845-37e6-4966-9077-baba3364c6b5 None None] MFA Rules not processed for user `dfeb8fa3a8834464a31953bdb5958318`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:44.528378 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-71202845-37e6-4966-9077-baba3364c6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:44.703224 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 600/1191] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 00:58:44 2022] POST /identity/v3/auth/tokens => generated 2889 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:58:44.723384 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705c3c0-d5a7-434c-9f8e-65b0d63d60e2 admin admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:44.727569 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-b705c3c0-d5a7-434c-9f8e-65b0d63d60e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:44.745166 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a4624-25f0-4e04-a024-4cfa2c68d225 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:44.745546 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a4624-25f0-4e04-a024-4cfa2c68d225 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:44.745826 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a4624-25f0-4e04-a024-4cfa2c68d225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:44.789444 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-5a6a4624-25f0-4e04-a024-4cfa2c68d225 None None] MFA Rules not processed for user `30da4a0a6371411b8a6b60791ff88416`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:44.792583 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-5a6a4624-25f0-4e04-a024-4cfa2c68d225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:44.827810 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705c3c0-d5a7-434c-9f8e-65b0d63d60e2 admin admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:44.830037 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300d77b-10ad-4216-bc12-25910ccf03b6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930b863db5db4586be6176c18a3bafd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:44.830833 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300d77b-10ad-4216-bc12-25910ccf03b6 service glance] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:44.831270 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300d77b-10ad-4216-bc12-25910ccf03b6 service glance] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:44.831694 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300d77b-10ad-4216-bc12-25910ccf03b6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:44.885307 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 601/1192] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 00:58:44 2022] POST /identity/v3/auth/tokens => generated 2881 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:58:44.902811 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a4624-25f0-4e04-a024-4cfa2c68d225 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:44.904398 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-5a6a4624-25f0-4e04-a024-4cfa2c68d225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:44.918165 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300d77b-10ad-4216-bc12-25910ccf03b6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:44.918831 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a4624-25f0-4e04-a024-4cfa2c68d225 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:44.920368 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300d77b-10ad-4216-bc12-25910ccf03b6 service glance] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:44.922653 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33601f7f-b83b-4872-aa76-367fb541c7a1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930b863db5db4586be6176c18a3bafd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:44.923260 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33601f7f-b83b-4872-aa76-367fb541c7a1 service glance] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:44.923540 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33601f7f-b83b-4872-aa76-367fb541c7a1 service glance] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:44.923850 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33601f7f-b83b-4872-aa76-367fb541c7a1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:44.935979 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 592/1193] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:58:44 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:58:44.949934 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=100 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:44.992134 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33601f7f-b83b-4872-aa76-367fb541c7a1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:44.993641 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33601f7f-b83b-4872-aa76-367fb541c7a1 service glance] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:45.003215 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 602/1194] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:58:44 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:58:54.930342 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=75,keystone:INSERT=5 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:55.222995 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=18 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:58:55.847716 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8f4d1-e534-41d9-9828-3f246866c145 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:55.848000 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8f4d1-e534-41d9-9828-3f246866c145 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:55.848233 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8f4d1-e534-41d9-9828-3f246866c145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:55.867452 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-cde8f4d1-e534-41d9-9828-3f246866c145 None None] MFA Rules not processed for user `55abc026ec1d47eca664bb9e9532ec8f`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:55.869221 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-cde8f4d1-e534-41d9-9828-3f246866c145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:55.876235 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 593/1195] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 00:58:55 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:58:56.178914 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21566bb0-77ef-4b69-9b80-2977a2013d0a None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:56.179263 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21566bb0-77ef-4b69-9b80-2977a2013d0a None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:56.179554 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21566bb0-77ef-4b69-9b80-2977a2013d0a None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:56.181735 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 603/1196] 10.222.0.20 () {54 vars in 962 bytes} [Fri Aug 26 00:58:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:58:56.186826 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434beed-3535-44f9-bb91-6306370290cf None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:56.187337 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434beed-3535-44f9-bb91-6306370290cf None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:56.187433 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434beed-3535-44f9-bb91-6306370290cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:56.210484 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-4434beed-3535-44f9-bb91-6306370290cf None None] MFA Rules not processed for user `02f74984033043ecabd28df33960a37c`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:56.211717 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-4434beed-3535-44f9-bb91-6306370290cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:56.281984 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 594/1197] 10.222.0.20 () {58 vars in 1059 bytes} [Fri Aug 26 00:58:56 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:58:56.287401 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c90fdb-6a23-4162-8c0f-ee1c3f771f92 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:56.287903 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c90fdb-6a23-4162-8c0f-ee1c3f771f92 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:56.288022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c90fdb-6a23-4162-8c0f-ee1c3f771f92 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:56.289281 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 604/1198] 10.222.0.20 () {54 vars in 912 bytes} [Fri Aug 26 00:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:58:56.294910 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c2260-7707-446c-8ecb-31509ff3527d None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:56.295234 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c2260-7707-446c-8ecb-31509ff3527d None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:56.295524 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c2260-7707-446c-8ecb-31509ff3527d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:56.315810 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-0f4c2260-7707-446c-8ecb-31509ff3527d None None] MFA Rules not processed for user `02f74984033043ecabd28df33960a37c`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:56.317031 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-0f4c2260-7707-446c-8ecb-31509ff3527d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:56.326133 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 595/1199] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Aug 26 00:58:56 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:58:56.338441 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c90fdb-6a23-4162-8c0f-ee1c3f771f92 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:56.351022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c90fdb-6a23-4162-8c0f-ee1c3f771f92 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:56.355550 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08bfba-2dc9-4804-bf23-f9bbfef33f6d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '930b863db5db4586be6176c18a3bafd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:56.356095 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08bfba-2dc9-4804-bf23-f9bbfef33f6d service glance] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:56.356373 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08bfba-2dc9-4804-bf23-f9bbfef33f6d service glance] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:56.356682 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08bfba-2dc9-4804-bf23-f9bbfef33f6d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:56.366556 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08bfba-2dc9-4804-bf23-f9bbfef33f6d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:56.368022 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08bfba-2dc9-4804-bf23-f9bbfef33f6d service glance] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:56.379315 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 605/1200] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:58:56 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:58:56.726037 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7ec8e-67ad-461a-a8d3-30a32ae31ee0 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:56.726328 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7ec8e-67ad-461a-a8d3-30a32ae31ee0 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:56.726611 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7ec8e-67ad-461a-a8d3-30a32ae31ee0 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:56.728948 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 596/1201] 10.222.0.20 () {54 vars in 912 bytes} [Fri Aug 26 00:58:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:58:56.734626 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1f69c-f3ca-42b2-96ec-5462e876546c None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:56.735144 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1f69c-f3ca-42b2-96ec-5462e876546c None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:56.735425 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1f69c-f3ca-42b2-96ec-5462e876546c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:56.760360 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-24b1f69c-f3ca-42b2-96ec-5462e876546c None None] MFA Rules not processed for user `fd3d4bf8049a44749b6be1d565303176`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:56.761658 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-24b1f69c-f3ca-42b2-96ec-5462e876546c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:56.816993 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 606/1202] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Aug 26 00:58:56 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:58:56.828492 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7ec8e-67ad-461a-a8d3-30a32ae31ee0 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:56.840501 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7ec8e-67ad-461a-a8d3-30a32ae31ee0 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:56.844149 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff46a60-ef7c-4d93-8903-611cfddf245a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:56.844810 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff46a60-ef7c-4d93-8903-611cfddf245a service neutron] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:56.845098 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff46a60-ef7c-4d93-8903-611cfddf245a service neutron] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:56.845398 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff46a60-ef7c-4d93-8903-611cfddf245a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:56.857584 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff46a60-ef7c-4d93-8903-611cfddf245a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:56.859049 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff46a60-ef7c-4d93-8903-611cfddf245a service neutron] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:56.868474 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 597/1203] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:58:56 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:58:57.506258 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a9167-1ea0-4e78-b571-78037418a005 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:57.506833 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a9167-1ea0-4e78-b571-78037418a005 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:57.507021 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a9167-1ea0-4e78-b571-78037418a005 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:57.508433 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 607/1204] 10.222.0.20 () {54 vars in 962 bytes} [Fri Aug 26 00:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:58:57.515012 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702728f7-990a-4563-96ab-8e48ab75fcf0 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:57.515533 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702728f7-990a-4563-96ab-8e48ab75fcf0 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:57.515644 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702728f7-990a-4563-96ab-8e48ab75fcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:57.541122 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a9167-1ea0-4e78-b571-78037418a005 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:57.544466 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-702728f7-990a-4563-96ab-8e48ab75fcf0 None None] MFA Rules not processed for user `02f74984033043ecabd28df33960a37c`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:57.545877 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-702728f7-990a-4563-96ab-8e48ab75fcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:57.562186 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 598/1205] 10.222.0.20 () {58 vars in 1059 bytes} [Fri Aug 26 00:58:57 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:58:57.563785 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccaaf96-261c-4da8-b96f-ec7845edcb32 None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:57.564003 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccaaf96-261c-4da8-b96f-ec7845edcb32 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:57.564289 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccaaf96-261c-4da8-b96f-ec7845edcb32 None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:57.565720 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 599/1206] 10.222.0.20 () {54 vars in 912 bytes} [Fri Aug 26 00:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:58:57.571984 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066b2e2-f747-4cde-8793-80e5351ff8fc None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:57.574151 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066b2e2-f747-4cde-8793-80e5351ff8fc None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:57.574151 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066b2e2-f747-4cde-8793-80e5351ff8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:57.594841 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-3066b2e2-f747-4cde-8793-80e5351ff8fc None None] MFA Rules not processed for user `02f74984033043ecabd28df33960a37c`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:58:57.596407 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-3066b2e2-f747-4cde-8793-80e5351ff8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:57.607410 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 600/1207] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Aug 26 00:58:57 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:58:57.620348 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066b2e2-f747-4cde-8793-80e5351ff8fc None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:58:57.630810 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066b2e2-f747-4cde-8793-80e5351ff8fc None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:57.635259 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01722dd-ddfa-4d4c-8ee8-93175aa27c65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:57.635482 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a9167-1ea0-4e78-b571-78037418a005 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:58:57.635882 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01722dd-ddfa-4d4c-8ee8-93175aa27c65 service neutron] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:57.636162 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01722dd-ddfa-4d4c-8ee8-93175aa27c65 service neutron] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:57.636434 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01722dd-ddfa-4d4c-8ee8-93175aa27c65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:57.641040 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a72bbb-3c77-404b-8bae-287df74caae7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd74675b1a7a34a95b41f7f8714d47e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:58:57.642880 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a72bbb-3c77-404b-8bae-287df74caae7 service placement] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:58:57.642880 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a72bbb-3c77-404b-8bae-287df74caae7 service placement] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:58:57.642880 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a72bbb-3c77-404b-8bae-287df74caae7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:58:57.645143 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-e6a72bbb-3c77-404b-8bae-287df74caae7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:58:57.647374 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01722dd-ddfa-4d4c-8ee8-93175aa27c65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:57.648839 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01722dd-ddfa-4d4c-8ee8-93175aa27c65 service neutron] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:57.660122 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a72bbb-3c77-404b-8bae-287df74caae7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:58:57.662077 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 601/1208] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:58:57 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:58:57.662233 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a72bbb-3c77-404b-8bae-287df74caae7 service placement] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:58:57.675066 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 608/1209] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:58:57 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:59:07.656694 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=53 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:07.669719 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=61 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:10.110365 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2c06e-674e-4af0-8508-3c7965ed2aed None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:10.110920 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2c06e-674e-4af0-8508-3c7965ed2aed None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:10.111100 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2c06e-674e-4af0-8508-3c7965ed2aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:10.132532 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-b1b2c06e-674e-4af0-8508-3c7965ed2aed None None] MFA Rules not processed for user `fd3d4bf8049a44749b6be1d565303176`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:59:10.133801 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-b1b2c06e-674e-4af0-8508-3c7965ed2aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:10.141887 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 602/1210] 10.222.0.17 () {58 vars in 1015 bytes} [Fri Aug 26 00:59:10 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:59:10.153589 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a72bbb-3c77-404b-8bae-287df74caae7 service placement] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:59:10.163974 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a72bbb-3c77-404b-8bae-287df74caae7 service placement] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:59:10.167889 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfbb7b-2079-4521-87e7-7a62080f6b8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:59:10.168695 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfbb7b-2079-4521-87e7-7a62080f6b8b service neutron] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:10.169168 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfbb7b-2079-4521-87e7-7a62080f6b8b service neutron] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:10.169512 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfbb7b-2079-4521-87e7-7a62080f6b8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:10.177035 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dfbb7b-2079-4521-87e7-7a62080f6b8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:59:10.178506 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dfbb7b-2079-4521-87e7-7a62080f6b8b service neutron] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:59:10.187930 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 609/1211] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:59:10 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:59:11.586961 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5beb92-40b1-491a-a268-017927c756af None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:11.587650 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5beb92-40b1-491a-a268-017927c756af None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:11.587650 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5beb92-40b1-491a-a268-017927c756af None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:11.589603 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 603/1212] 10.222.0.20 () {54 vars in 921 bytes} [Fri Aug 26 00:59:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:59:11.596529 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f72ab-443e-4414-85eb-54a3295d598c None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:11.597191 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f72ab-443e-4414-85eb-54a3295d598c None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:11.597191 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f72ab-443e-4414-85eb-54a3295d598c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:11.619545 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-287f72ab-443e-4414-85eb-54a3295d598c None None] MFA Rules not processed for user `02f74984033043ecabd28df33960a37c`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:59:11.620985 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-287f72ab-443e-4414-85eb-54a3295d598c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:11.630257 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 610/1213] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Aug 26 00:59:11 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:59:11.646419 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5beb92-40b1-491a-a268-017927c756af None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:59:11.662144 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5beb92-40b1-491a-a268-017927c756af None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:59:11.668397 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788a17f-065a-472b-9c9a-6245e9439e32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f74984033043ecabd28df33960a37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:59:11.669116 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788a17f-065a-472b-9c9a-6245e9439e32 service nova] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:11.669426 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788a17f-065a-472b-9c9a-6245e9439e32 service nova] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:11.669711 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788a17f-065a-472b-9c9a-6245e9439e32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:11.679555 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788a17f-065a-472b-9c9a-6245e9439e32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:59:11.681947 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788a17f-065a-472b-9c9a-6245e9439e32 service nova] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:59:11.697886 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 604/1214] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:59:11 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:59:18.805278 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e588784-800b-4f8a-88e2-4473da65b2dd None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:18.805962 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e588784-800b-4f8a-88e2-4473da65b2dd None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:18.805962 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e588784-800b-4f8a-88e2-4473da65b2dd None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:18.807211 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 611/1215] 10.222.0.20 () {54 vars in 921 bytes} [Fri Aug 26 00:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:59:18.814636 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa9a39-62fa-4c60-b6d1-86f61d767b01 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:18.815179 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa9a39-62fa-4c60-b6d1-86f61d767b01 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:18.815179 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa9a39-62fa-4c60-b6d1-86f61d767b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:18.837156 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-4daa9a39-62fa-4c60-b6d1-86f61d767b01 None None] MFA Rules not processed for user `02f74984033043ecabd28df33960a37c`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:59:18.838485 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-4daa9a39-62fa-4c60-b6d1-86f61d767b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:59:18.849358 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 605/1216] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Aug 26 00:59:18 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:59:18.864115 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e588784-800b-4f8a-88e2-4473da65b2dd None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:59:18.878397 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e588784-800b-4f8a-88e2-4473da65b2dd None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:59:18.883629 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7203f-a78b-4d0d-b78d-19b68211c32e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f74984033043ecabd28df33960a37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:59:18.884551 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7203f-a78b-4d0d-b78d-19b68211c32e service nova] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:18.884930 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7203f-a78b-4d0d-b78d-19b68211c32e service nova] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:18.885367 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7203f-a78b-4d0d-b78d-19b68211c32e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:18.894967 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c7203f-a78b-4d0d-b78d-19b68211c32e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:59:18.896692 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c7203f-a78b-4d0d-b78d-19b68211c32e service nova] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:59:18.909014 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 612/1217] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:59:18 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:59:28.831297 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=12 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:28.904520 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=15 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:59:37.539171 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa9a39-62fa-4c60-b6d1-86f61d767b01 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:59:37.548715 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa9a39-62fa-4c60-b6d1-86f61d767b01 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:59:37.552973 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686092b1-67df-47df-a3ae-1580f5c7757c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:59:37.553644 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686092b1-67df-47df-a3ae-1580f5c7757c service neutron] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:59:37.553929 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686092b1-67df-47df-a3ae-1580f5c7757c service neutron] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:59:37.554204 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686092b1-67df-47df-a3ae-1580f5c7757c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:59:37.564506 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686092b1-67df-47df-a3ae-1580f5c7757c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:59:37.566026 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686092b1-67df-47df-a3ae-1580f5c7757c service neutron] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:59:37.577215 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 606/1218] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 00:59:37 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:59:47.571680 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=6 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:01:14.947410 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d4ff3-c222-4661-9eb5-449bd95d7d22 None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:01:14.947848 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d4ff3-c222-4661-9eb5-449bd95d7d22 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:01:14.947995 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d4ff3-c222-4661-9eb5-449bd95d7d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:01:14.977051 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-4a6d4ff3-c222-4661-9eb5-449bd95d7d22 None None] MFA Rules not processed for user `fb9c3d14579149b98917e7d099daa924`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:01:14.978313 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-4a6d4ff3-c222-4661-9eb5-449bd95d7d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:01:15.006636 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 613/1219] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 01:01:14 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:01:15.321902 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82cba3-3d92-4c57-8ad9-c89e82a37f95 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:01:15.322441 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82cba3-3d92-4c57-8ad9-c89e82a37f95 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:01:15.322539 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82cba3-3d92-4c57-8ad9-c89e82a37f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:01:15.392920 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-0a82cba3-3d92-4c57-8ad9-c89e82a37f95 None None] MFA Rules not processed for user `fd3d4bf8049a44749b6be1d565303176`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:01:15.394182 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-0a82cba3-3d92-4c57-8ad9-c89e82a37f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:01:15.426884 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 607/1220] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Aug 26 01:01:15 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:01:15.439203 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d4ff3-c222-4661-9eb5-449bd95d7d22 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:01:15.449936 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d4ff3-c222-4661-9eb5-449bd95d7d22 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:01:15.454569 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb03b5-b311-4c62-8259-dc05649db830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:01:15.455175 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb03b5-b311-4c62-8259-dc05649db830 service neutron] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:01:15.455455 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb03b5-b311-4c62-8259-dc05649db830 service neutron] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:01:15.455731 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb03b5-b311-4c62-8259-dc05649db830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:01:15.464055 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb03b5-b311-4c62-8259-dc05649db830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:01:15.465572 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb03b5-b311-4c62-8259-dc05649db830 service neutron] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:01:15.474404 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 614/1221] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 01:01:15 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 01:01:25.424200 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=33 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:01:25.470739 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=21 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:01:58.739202 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4475d5c-2d94-49bb-a9fb-a4430636a606 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:01:58.739712 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4475d5c-2d94-49bb-a9fb-a4430636a606 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:01:58.739803 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4475d5c-2d94-49bb-a9fb-a4430636a606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:01:58.758651 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-c4475d5c-2d94-49bb-a9fb-a4430636a606 None None] MFA Rules not processed for user `fb9c3d14579149b98917e7d099daa924`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:01:58.759922 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-c4475d5c-2d94-49bb-a9fb-a4430636a606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:01:58.767936 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 608/1222] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 01:01:58 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:02:05.003531 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b98fc8-ae00-4e98-ae2b-430a765ca73c None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:05.004021 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b98fc8-ae00-4e98-ae2b-430a765ca73c None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:05.004123 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b98fc8-ae00-4e98-ae2b-430a765ca73c None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:05.005498 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 615/1223] 10.222.0.20 () {54 vars in 961 bytes} [Fri Aug 26 01:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 01:02:05.010540 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729a5fa-cd64-40a1-8fc2-fac7adb58ae1 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:05.011381 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729a5fa-cd64-40a1-8fc2-fac7adb58ae1 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:05.011381 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729a5fa-cd64-40a1-8fc2-fac7adb58ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:05.050835 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-2729a5fa-cd64-40a1-8fc2-fac7adb58ae1 None None] MFA Rules not processed for user `d74675b1a7a34a95b41f7f8714d47e43`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:02:05.052059 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-2729a5fa-cd64-40a1-8fc2-fac7adb58ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:02:05.077306 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 609/1224] 10.222.0.20 () {58 vars in 1058 bytes} [Fri Aug 26 01:02:05 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:02:05.084866 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b98fc8-ae00-4e98-ae2b-430a765ca73c None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:02:05.099297 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b98fc8-ae00-4e98-ae2b-430a765ca73c None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:02:05.104287 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eca303-8185-4f7f-9cf2-5e6e13186477 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd74675b1a7a34a95b41f7f8714d47e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:02:05.104889 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eca303-8185-4f7f-9cf2-5e6e13186477 service placement] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:05.105173 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eca303-8185-4f7f-9cf2-5e6e13186477 service placement] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:05.105486 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eca303-8185-4f7f-9cf2-5e6e13186477 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:05.115261 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eca303-8185-4f7f-9cf2-5e6e13186477 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:02:05.116880 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eca303-8185-4f7f-9cf2-5e6e13186477 service placement] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:02:05.127040 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 616/1225] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 01:02:05 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:02:15.074358 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=19 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:02:15.122701 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=6 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:02:21.906382 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da105088-af10-4aa9-97f5-baf09f0a52e8 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:21.906896 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da105088-af10-4aa9-97f5-baf09f0a52e8 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:21.907006 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da105088-af10-4aa9-97f5-baf09f0a52e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:21.927281 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-da105088-af10-4aa9-97f5-baf09f0a52e8 None None] MFA Rules not processed for user `fb9c3d14579149b98917e7d099daa924`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:02:21.928512 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-da105088-af10-4aa9-97f5-baf09f0a52e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:02:21.935707 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 610/1226] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 01:02:21 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 01:02:31.921324 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=3 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:03:08.950870 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e245b3f-4148-44c2-97dc-d0ac5c11a125 None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:08.951990 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e245b3f-4148-44c2-97dc-d0ac5c11a125 None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:08.952349 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e245b3f-4148-44c2-97dc-d0ac5c11a125 None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:08.953847 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 617/1227] 10.222.0.20 () {54 vars in 921 bytes} [Fri Aug 26 01:03:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 01:03:08.959460 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20516bb7-a437-4a58-8295-39a933cf448a None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:08.959904 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20516bb7-a437-4a58-8295-39a933cf448a None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:08.960214 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20516bb7-a437-4a58-8295-39a933cf448a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:09.021763 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-20516bb7-a437-4a58-8295-39a933cf448a None None] MFA Rules not processed for user `02f74984033043ecabd28df33960a37c`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:09.022678 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-20516bb7-a437-4a58-8295-39a933cf448a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:09.044019 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 611/1228] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Aug 26 01:03:08 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:03:09.058185 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e245b3f-4148-44c2-97dc-d0ac5c11a125 None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:03:09.081676 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e245b3f-4148-44c2-97dc-d0ac5c11a125 None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:03:09.087074 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702b55c-c753-45b3-80d0-4c511e70e0a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f74984033043ecabd28df33960a37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:03:09.087699 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702b55c-c753-45b3-80d0-4c511e70e0a8 service nova] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:09.087983 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702b55c-c753-45b3-80d0-4c511e70e0a8 service nova] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:09.088259 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702b55c-c753-45b3-80d0-4c511e70e0a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:09.098806 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702b55c-c753-45b3-80d0-4c511e70e0a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:03:09.104733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702b55c-c753-45b3-80d0-4c511e70e0a8 service nova] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:03:09.112008 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 618/1229] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 01:03:09 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:03:19.040542 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=18 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:03:19.107711 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=6 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:03:34.409495 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d022ba3-a4bc-4be9-828b-49b7c50d0ba9 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:34.410065 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d022ba3-a4bc-4be9-828b-49b7c50d0ba9 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:34.410065 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d022ba3-a4bc-4be9-828b-49b7c50d0ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:34.430334 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-3d022ba3-a4bc-4be9-828b-49b7c50d0ba9 None None] MFA Rules not processed for user `55abc026ec1d47eca664bb9e9532ec8f`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:34.431583 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-3d022ba3-a4bc-4be9-828b-49b7c50d0ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:34.439513 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 612/1230] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 01:03:34 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:03:44.424881 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=3 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:03:44.650073 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702b55c-c753-45b3-80d0-4c511e70e0a8 service nova] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:03:44.662304 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702b55c-c753-45b3-80d0-4c511e70e0a8 service nova] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:03:44.667000 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a68790-b9b8-4553-8aab-a446cd662274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:03:44.667936 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a68790-b9b8-4553-8aab-a446cd662274 service neutron] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:44.669073 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a68790-b9b8-4553-8aab-a446cd662274 service neutron] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:44.670003 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a68790-b9b8-4553-8aab-a446cd662274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:44.680151 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a68790-b9b8-4553-8aab-a446cd662274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:03:44.681719 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a68790-b9b8-4553-8aab-a446cd662274 service neutron] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:03:44.692456 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 619/1231] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 01:03:44 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:03:44.693141 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d022ba3-a4bc-4be9-828b-49b7c50d0ba9 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:03:44.705537 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d022ba3-a4bc-4be9-828b-49b7c50d0ba9 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:03:44.711863 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb46c54-2dc5-4228-9e7c-674d4e63dc62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:03:44.712850 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb46c54-2dc5-4228-9e7c-674d4e63dc62 service neutron] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:44.713324 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb46c54-2dc5-4228-9e7c-674d4e63dc62 service neutron] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:44.713886 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb46c54-2dc5-4228-9e7c-674d4e63dc62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:44.728428 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb46c54-2dc5-4228-9e7c-674d4e63dc62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:03:44.729939 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb46c54-2dc5-4228-9e7c-674d4e63dc62 service neutron] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:03:44.740575 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 613/1232] 10.222.0.20 () {60 vars in 1396 bytes} [Fri Aug 26 01:03:44 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 2822 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 01:03:54.687800 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=6 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:03:54.735985 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=6 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:03:55.859730 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6742615-653e-4ff6-8fc3-a7fe7b31871a None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:55.860374 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6742615-653e-4ff6-8fc3-a7fe7b31871a None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:55.860374 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6742615-653e-4ff6-8fc3-a7fe7b31871a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:55.879392 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-c6742615-653e-4ff6-8fc3-a7fe7b31871a None None] MFA Rules not processed for user `fb9c3d14579149b98917e7d099daa924`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:55.880621 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-c6742615-653e-4ff6-8fc3-a7fe7b31871a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:55.888532 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 620/1233] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 26 01:03:55 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:03:55.929806 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb46c54-2dc5-4228-9e7c-674d4e63dc62 service neutron] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:03:56.008725 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb46c54-2dc5-4228-9e7c-674d4e63dc62 service neutron] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:03:56.012911 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac3d37-3d20-4bc0-a8fa-d32f41fc4c76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85a98342482a4031b6d87cb1d0fbaea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:03:56.014097 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac3d37-3d20-4bc0-a8fa-d32f41fc4c76 service cinder] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:56.014398 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac3d37-3d20-4bc0-a8fa-d32f41fc4c76 service cinder] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:56.014674 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac3d37-3d20-4bc0-a8fa-d32f41fc4c76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:56.026086 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac3d37-3d20-4bc0-a8fa-d32f41fc4c76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:03:56.027576 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac3d37-3d20-4bc0-a8fa-d32f41fc4c76 service cinder] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:03:56.039125 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 614/1234] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 01:03:55 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:03:59.754499 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6742615-653e-4ff6-8fc3-a7fe7b31871a None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:03:59.766071 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6742615-653e-4ff6-8fc3-a7fe7b31871a None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:03:59.770017 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5d7e4-61bc-407e-a018-5f93cea5d9b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:03:59.770640 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5d7e4-61bc-407e-a018-5f93cea5d9b0 service neutron] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:59.770920 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5d7e4-61bc-407e-a018-5f93cea5d9b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:59.771264 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5d7e4-61bc-407e-a018-5f93cea5d9b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:59.783344 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5d7e4-61bc-407e-a018-5f93cea5d9b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:03:59.784924 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5d7e4-61bc-407e-a018-5f93cea5d9b0 service neutron] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:03:59.799675 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 621/1235] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 01:03:59 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:04:06.034027 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=30 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:04:09.791375 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=9 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:04:10.078765 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac3d37-3d20-4bc0-a8fa-d32f41fc4c76 service cinder] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:04:10.088079 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac3d37-3d20-4bc0-a8fa-d32f41fc4c76 service cinder] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:04:10.092302 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b2150-fd17-492f-8a2a-8c77ad1bede0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:04:10.092918 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b2150-fd17-492f-8a2a-8c77ad1bede0 service neutron] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:10.094925 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b2150-fd17-492f-8a2a-8c77ad1bede0 service neutron] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:10.094925 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b2150-fd17-492f-8a2a-8c77ad1bede0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:10.102284 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b2150-fd17-492f-8a2a-8c77ad1bede0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:04:10.103809 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b2150-fd17-492f-8a2a-8c77ad1bede0 service neutron] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:04:10.114409 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 615/1236] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 01:04:10 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:04:13.560408 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5d7e4-61bc-407e-a018-5f93cea5d9b0 service neutron] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:04:13.569430 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5d7e4-61bc-407e-a018-5f93cea5d9b0 service neutron] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:04:13.575673 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ca961-1c42-4b3f-a0d2-0f8f64772e82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:04:13.575673 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ca961-1c42-4b3f-a0d2-0f8f64772e82 service neutron] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:13.575673 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ca961-1c42-4b3f-a0d2-0f8f64772e82 service neutron] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:13.575673 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ca961-1c42-4b3f-a0d2-0f8f64772e82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:13.585059 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ca961-1c42-4b3f-a0d2-0f8f64772e82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:04:13.586672 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ca961-1c42-4b3f-a0d2-0f8f64772e82 service neutron] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:04:13.597203 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 622/1237] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 01:04:13 2022] GET /identity/v3/auth/tokens => generated 2881 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 01:04:13.757425 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b2150-fd17-492f-8a2a-8c77ad1bede0 service neutron] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:04:13.778486 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b2150-fd17-492f-8a2a-8c77ad1bede0 service neutron] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:04:13.789788 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10b2c7-88ec-4fb0-beae-cdafd6165646 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f74984033043ecabd28df33960a37c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:04:13.790441 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10b2c7-88ec-4fb0-beae-cdafd6165646 service nova] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:13.790926 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10b2c7-88ec-4fb0-beae-cdafd6165646 service nova] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:13.791378 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10b2c7-88ec-4fb0-beae-cdafd6165646 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:13.823880 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10b2c7-88ec-4fb0-beae-cdafd6165646 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:04:13.825514 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10b2c7-88ec-4fb0-beae-cdafd6165646 service nova] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:04:13.851676 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 616/1238] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 01:04:13 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:04:23.592757 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=6 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:04:23.836401 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=12 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:05:36.743924 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ca961-1c42-4b3f-a0d2-0f8f64772e82 service neutron] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:36.752372 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ca961-1c42-4b3f-a0d2-0f8f64772e82 service neutron] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:36.756248 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508abda4-accd-4831-887c-1d2def1886e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:36.762964 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508abda4-accd-4831-887c-1d2def1886e3 service neutron] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:36.762964 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508abda4-accd-4831-887c-1d2def1886e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:36.762964 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508abda4-accd-4831-887c-1d2def1886e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:36.832724 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508abda4-accd-4831-887c-1d2def1886e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:36.841957 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508abda4-accd-4831-887c-1d2def1886e3 service neutron] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:36.856696 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 623/1239] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 01:05:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:05:41.065924 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a5af8-8ebb-4b01-abd8-bf20b98af01d None None] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:41.066496 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a5af8-8ebb-4b01-abd8-bf20b98af01d None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:41.066588 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a5af8-8ebb-4b01-abd8-bf20b98af01d None None] PATH_INFO: `/` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:41.067907 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 617/1240] 10.222.0.20 () {54 vars in 921 bytes} [Fri Aug 26 01:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 01:05:41.096238 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e3d33-eedd-46e6-8896-57f4a7d879ef None None] REQUEST_METHOD: `POST` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:41.096755 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e3d33-eedd-46e6-8896-57f4a7d879ef None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:41.096755 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e3d33-eedd-46e6-8896-57f4a7d879ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:41.138031 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.auth.core [None req-021e3d33-eedd-46e6-8896-57f4a7d879ef None None] MFA Rules not processed for user `d74675b1a7a34a95b41f7f8714d47e43`. Rule list: `[]` (Enabled: `True`). {{(pid=95125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:05:41.139174 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-021e3d33-eedd-46e6-8896-57f4a7d879ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:41.149783 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 624/1241] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Aug 26 01:05:41 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:05:41.160798 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a5af8-8ebb-4b01-abd8-bf20b98af01d None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:41.175744 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a5af8-8ebb-4b01-abd8-bf20b98af01d None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:41.181512 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035f9cc-17ac-42e3-90eb-a6a7d8fbdb42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd74675b1a7a34a95b41f7f8714d47e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:41.182134 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035f9cc-17ac-42e3-90eb-a6a7d8fbdb42 service placement] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:41.182419 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035f9cc-17ac-42e3-90eb-a6a7d8fbdb42 service placement] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:41.182698 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035f9cc-17ac-42e3-90eb-a6a7d8fbdb42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:41.191780 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5035f9cc-17ac-42e3-90eb-a6a7d8fbdb42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:41.194107 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5035f9cc-17ac-42e3-90eb-a6a7d8fbdb42 service placement] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:41.203757 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 618/1242] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 01:05:41 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:05:45.558188 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cada38e-a7c3-4e23-bed2-f87cca40027b None None] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:45.558733 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cada38e-a7c3-4e23-bed2-f87cca40027b None None] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:45.558831 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cada38e-a7c3-4e23-bed2-f87cca40027b None None] PATH_INFO: `/` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:45.560155 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 625/1243] 10.222.0.20 () {54 vars in 921 bytes} [Fri Aug 26 01:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 01:05:45.741894 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7d928-ae5a-494a-b72a-69b15ead0ed9 None None] REQUEST_METHOD: `POST` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:45.742612 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7d928-ae5a-494a-b72a-69b15ead0ed9 None None] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:45.742612 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7d928-ae5a-494a-b72a-69b15ead0ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:45.763824 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.auth.core [None req-f3c7d928-ae5a-494a-b72a-69b15ead0ed9 None None] MFA Rules not processed for user `d74675b1a7a34a95b41f7f8714d47e43`. Rule list: `[]` (Enabled: `True`). {{(pid=95124) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:05:45.765137 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-f3c7d928-ae5a-494a-b72a-69b15ead0ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:45.774959 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 619/1244] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Aug 26 01:05:45 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:05:45.786611 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cada38e-a7c3-4e23-bed2-f87cca40027b None None] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:45.803294 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cada38e-a7c3-4e23-bed2-f87cca40027b None None] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:45.809130 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3011d-1aea-464b-bf05-6ff82788c6f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd74675b1a7a34a95b41f7f8714d47e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:45.809872 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3011d-1aea-464b-bf05-6ff82788c6f6 service placement] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:45.810156 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3011d-1aea-464b-bf05-6ff82788c6f6 service placement] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:45.810434 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3011d-1aea-464b-bf05-6ff82788c6f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:45.821687 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3011d-1aea-464b-bf05-6ff82788c6f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:45.823365 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3011d-1aea-464b-bf05-6ff82788c6f6 service placement] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:45.835164 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 626/1245] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 01:05:45 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:05:45.952563 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7d928-ae5a-494a-b72a-69b15ead0ed9 None None] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:45.974391 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7d928-ae5a-494a-b72a-69b15ead0ed9 None None] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:45.980979 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0513c5-a327-483a-a173-03cd13329ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:45.981881 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0513c5-a327-483a-a173-03cd13329ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:45.982192 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0513c5-a327-483a-a173-03cd13329ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:45.982492 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0513c5-a327-483a-a173-03cd13329ab4 admin admin] PATH_INFO: `/v3/users/55abc026ec1d47eca664bb9e9532ec8f` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:45.984017 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0513c5-a327-483a-a173-03cd13329ab4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55abc026ec1d47eca664bb9e9532ec8f)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:45.984761 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: WARNING py.warnings [None req-3a0513c5-a327-483a-a173-03cd13329ab4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 01:05:45.984761 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: warnings.warn(msg) Aug 26 01:05:45.984761 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: Aug 26 01:05:45.986037 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0513c5-a327-483a-a173-03cd13329ab4 admin admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:46.198011 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [None req-3a0513c5-a327-483a-a173-03cd13329ab4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55abc026ec1d47eca664bb9e9532ec8f'} {{(pid=95124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:05:46.209629 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [None req-3a0513c5-a327-483a-a173-03cd13329ab4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55abc026ec1d47eca664bb9e9532ec8f'} {{(pid=95124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:05:46.234554 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [None req-3a0513c5-a327-483a-a173-03cd13329ab4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55abc026ec1d47eca664bb9e9532ec8f'} {{(pid=95124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:05:46.235458 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [None req-3a0513c5-a327-483a-a173-03cd13329ab4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55abc026ec1d47eca664bb9e9532ec8f'} {{(pid=95124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:05:46.372234 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [None req-3a0513c5-a327-483a-a173-03cd13329ab4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55abc026ec1d47eca664bb9e9532ec8f'} {{(pid=95124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:05:46.378795 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 620/1246] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 01:05:45 2022] DELETE /identity/v3/users/55abc026ec1d47eca664bb9e9532ec8f => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:05:46.938492 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3011d-1aea-464b-bf05-6ff82788c6f6 service placement] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:46.959578 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3011d-1aea-464b-bf05-6ff82788c6f6 service placement] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:47.028199 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da4001-f7b0-4410-9231-241088eacaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:47.028767 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da4001-f7b0-4410-9231-241088eacaf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:47.029050 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da4001-f7b0-4410-9231-241088eacaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:47.029326 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da4001-f7b0-4410-9231-241088eacaf3 admin admin] PATH_INFO: `/v3/projects/2cf8f9decaf34b8da82724b855c2a982` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:47.030497 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da4001-f7b0-4410-9231-241088eacaf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cf8f9decaf34b8da82724b855c2a982)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:47.031520 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: WARNING py.warnings [None req-09da4001-f7b0-4410-9231-241088eacaf3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 01:05:47.031520 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: warnings.warn(msg) Aug 26 01:05:47.031520 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: Aug 26 01:05:47.032716 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da4001-f7b0-4410-9231-241088eacaf3 admin admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:47.156618 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:05:47.157942 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [None req-09da4001-f7b0-4410-9231-241088eacaf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cf8f9decaf34b8da82724b855c2a982', 'request_id': 'req-09da4001-f7b0-4410-9231-241088eacaf3'} {{(pid=95125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:05:47.164708 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [None req-09da4001-f7b0-4410-9231-241088eacaf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cf8f9decaf34b8da82724b855c2a982', 'request_id': 'req-09da4001-f7b0-4410-9231-241088eacaf3'} {{(pid=95125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:05:47.180760 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [None req-09da4001-f7b0-4410-9231-241088eacaf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cf8f9decaf34b8da82724b855c2a982', 'request_id': 'req-09da4001-f7b0-4410-9231-241088eacaf3'} {{(pid=95125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:05:47.342662 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [None req-09da4001-f7b0-4410-9231-241088eacaf3 admin admin] The token cache is being invalidate because project 2cf8f9decaf34b8da82724b855c2a982 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 01:05:47.342887 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [None req-09da4001-f7b0-4410-9231-241088eacaf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:05:47.343546 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [None req-09da4001-f7b0-4410-9231-241088eacaf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:05:47.345154 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 627/1247] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 01:05:46 2022] DELETE /identity/v3/projects/2cf8f9decaf34b8da82724b855c2a982 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:05:47.349399 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0513c5-a327-483a-a173-03cd13329ab4 admin admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:47.350910 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-3a0513c5-a327-483a-a173-03cd13329ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:47.365201 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0513c5-a327-483a-a173-03cd13329ab4 admin admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:47.427326 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b8aa2-2f71-4ff0-a467-13a6fceecfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:47.427972 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b8aa2-2f71-4ff0-a467-13a6fceecfbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:47.428257 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b8aa2-2f71-4ff0-a467-13a6fceecfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:47.428535 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b8aa2-2f71-4ff0-a467-13a6fceecfbb admin admin] PATH_INFO: `/v3/users/dfeb8fa3a8834464a31953bdb5958318` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:47.430440 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b8aa2-2f71-4ff0-a467-13a6fceecfbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfeb8fa3a8834464a31953bdb5958318)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:47.432493 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b8aa2-2f71-4ff0-a467-13a6fceecfbb admin admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:47.646509 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [None req-e08b8aa2-2f71-4ff0-a467-13a6fceecfbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfeb8fa3a8834464a31953bdb5958318'} {{(pid=95124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:05:47.652168 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:05:47.654176 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [None req-e08b8aa2-2f71-4ff0-a467-13a6fceecfbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfeb8fa3a8834464a31953bdb5958318'} {{(pid=95124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:05:47.666951 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [None req-e08b8aa2-2f71-4ff0-a467-13a6fceecfbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfeb8fa3a8834464a31953bdb5958318'} {{(pid=95124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:05:47.667763 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [None req-e08b8aa2-2f71-4ff0-a467-13a6fceecfbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfeb8fa3a8834464a31953bdb5958318'} {{(pid=95124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:05:47.809695 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [None req-e08b8aa2-2f71-4ff0-a467-13a6fceecfbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfeb8fa3a8834464a31953bdb5958318'} {{(pid=95124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:05:47.816280 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 621/1248] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 01:05:47 2022] DELETE /identity/v3/users/dfeb8fa3a8834464a31953bdb5958318 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:05:48.099847 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da4001-f7b0-4410-9231-241088eacaf3 admin admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:48.102253 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-09da4001-f7b0-4410-9231-241088eacaf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:48.116251 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da4001-f7b0-4410-9231-241088eacaf3 admin admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:48.180532 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae2a2a-d06a-40fb-856b-497d91181ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:48.181106 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae2a2a-d06a-40fb-856b-497d91181ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:48.181461 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae2a2a-d06a-40fb-856b-497d91181ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:48.181745 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae2a2a-d06a-40fb-856b-497d91181ecd admin admin] PATH_INFO: `/v3/projects/296e0ab05c4a42ae8c647c6974aaf349` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:48.182918 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae2a2a-d06a-40fb-856b-497d91181ecd admin admin] RBAC: Authorizing `identity:delete_project(project_id=296e0ab05c4a42ae8c647c6974aaf349)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:48.184834 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae2a2a-d06a-40fb-856b-497d91181ecd admin admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:48.322240 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [None req-7dae2a2a-d06a-40fb-856b-497d91181ecd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '296e0ab05c4a42ae8c647c6974aaf349', 'request_id': 'req-7dae2a2a-d06a-40fb-856b-497d91181ecd'} {{(pid=95125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:05:48.328461 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [None req-7dae2a2a-d06a-40fb-856b-497d91181ecd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '296e0ab05c4a42ae8c647c6974aaf349', 'request_id': 'req-7dae2a2a-d06a-40fb-856b-497d91181ecd'} {{(pid=95125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:05:48.335020 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [None req-7dae2a2a-d06a-40fb-856b-497d91181ecd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '296e0ab05c4a42ae8c647c6974aaf349', 'request_id': 'req-7dae2a2a-d06a-40fb-856b-497d91181ecd'} {{(pid=95125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:05:48.435153 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [None req-7dae2a2a-d06a-40fb-856b-497d91181ecd admin admin] The token cache is being invalidate because project 296e0ab05c4a42ae8c647c6974aaf349 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 01:05:48.435344 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [None req-7dae2a2a-d06a-40fb-856b-497d91181ecd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:05:48.436014 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [None req-7dae2a2a-d06a-40fb-856b-497d91181ecd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:05:48.437542 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 628/1249] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 01:05:48 2022] DELETE /identity/v3/projects/296e0ab05c4a42ae8c647c6974aaf349 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:05:57.906476 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=9,keystone:DELETE=3,keystone:INSERT=1 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:05:58.431796 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=63,keystone:DELETE=10,keystone:INSERT=2 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:07:48.840052 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b8aa2-2f71-4ff0-a467-13a6fceecfbb admin admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:07:48.841556 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-e08b8aa2-2f71-4ff0-a467-13a6fceecfbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:07:48.912816 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b8aa2-2f71-4ff0-a467-13a6fceecfbb admin admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:07:48.980599 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e79f3-94b6-49d9-a035-3ada698d8265 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd74675b1a7a34a95b41f7f8714d47e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:07:48.981222 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e79f3-94b6-49d9-a035-3ada698d8265 service placement] REQUEST_METHOD: `GET` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:07:48.981526 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e79f3-94b6-49d9-a035-3ada698d8265 service placement] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:07:48.981800 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e79f3-94b6-49d9-a035-3ada698d8265 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:07:48.983664 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-119e79f3-94b6-49d9-a035-3ada698d8265 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:07:48.996563 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e79f3-94b6-49d9-a035-3ada698d8265 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:07:48.998248 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e79f3-94b6-49d9-a035-3ada698d8265 service placement] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:07:49.009454 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 622/1250] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 01:07:48 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:07:59.005098 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=58 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:07:59.615112 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae2a2a-d06a-40fb-856b-497d91181ecd admin admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:07:59.616696 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-7dae2a2a-d06a-40fb-856b-497d91181ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:07:59.675976 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae2a2a-d06a-40fb-856b-497d91181ecd admin admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:07:59.679783 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556c5b5-bf6f-4870-83b1-4a0e94726c18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd3d4bf8049a44749b6be1d565303176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe7cc05cd9f44d74a635079ef883d9a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:07:59.684423 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556c5b5-bf6f-4870-83b1-4a0e94726c18 service neutron] REQUEST_METHOD: `GET` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:07:59.684423 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556c5b5-bf6f-4870-83b1-4a0e94726c18 service neutron] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:07:59.684423 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556c5b5-bf6f-4870-83b1-4a0e94726c18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:07:59.684423 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-2556c5b5-bf6f-4870-83b1-4a0e94726c18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:07:59.747847 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2556c5b5-bf6f-4870-83b1-4a0e94726c18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:07:59.749203 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2556c5b5-bf6f-4870-83b1-4a0e94726c18 service neutron] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:07:59.758839 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 629/1251] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 26 01:07:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:08:07.313745 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e79f3-94b6-49d9-a035-3ada698d8265 service placement] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:08:07.315326 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-119e79f3-94b6-49d9-a035-3ada698d8265 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:08:07.337175 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e79f3-94b6-49d9-a035-3ada698d8265 service placement] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:08:07.337175 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8474f-0c97-4d1f-878b-ca771a898d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:08:07.337540 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8474f-0c97-4d1f-878b-ca771a898d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:08:07.337893 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8474f-0c97-4d1f-878b-ca771a898d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:08:07.338375 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8474f-0c97-4d1f-878b-ca771a898d57 admin admin] PATH_INFO: `/v3/users/fb9c3d14579149b98917e7d099daa924` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:08:07.339603 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8474f-0c97-4d1f-878b-ca771a898d57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb9c3d14579149b98917e7d099daa924)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:08:07.341561 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8474f-0c97-4d1f-878b-ca771a898d57 admin admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:08:07.649273 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [None req-89f8474f-0c97-4d1f-878b-ca771a898d57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb9c3d14579149b98917e7d099daa924'} {{(pid=95124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:08:07.656668 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [None req-89f8474f-0c97-4d1f-878b-ca771a898d57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb9c3d14579149b98917e7d099daa924'} {{(pid=95124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:08:07.669420 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [None req-89f8474f-0c97-4d1f-878b-ca771a898d57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb9c3d14579149b98917e7d099daa924'} {{(pid=95124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:08:07.670148 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [None req-89f8474f-0c97-4d1f-878b-ca771a898d57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb9c3d14579149b98917e7d099daa924'} {{(pid=95124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:08:07.755002 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [None req-89f8474f-0c97-4d1f-878b-ca771a898d57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb9c3d14579149b98917e7d099daa924'} {{(pid=95124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:08:07.761727 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 623/1252] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 01:08:07 2022] DELETE /identity/v3/users/fb9c3d14579149b98917e7d099daa924 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:08:08.011701 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556c5b5-bf6f-4870-83b1-4a0e94726c18 service neutron] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:08:08.021917 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556c5b5-bf6f-4870-83b1-4a0e94726c18 service neutron] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:08:08.088146 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb2153-0838-4383-8a70-5e43513ee8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:08:08.091295 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb2153-0838-4383-8a70-5e43513ee8e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:08:08.091295 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb2153-0838-4383-8a70-5e43513ee8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:08:08.091295 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb2153-0838-4383-8a70-5e43513ee8e4 admin admin] PATH_INFO: `/v3/projects/11afc4d3c62b4f83a9af8f5375b18add` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:08:08.091295 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb2153-0838-4383-8a70-5e43513ee8e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11afc4d3c62b4f83a9af8f5375b18add)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:08:08.092693 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb2153-0838-4383-8a70-5e43513ee8e4 admin admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:08:08.186850 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [None req-42cb2153-0838-4383-8a70-5e43513ee8e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11afc4d3c62b4f83a9af8f5375b18add', 'request_id': 'req-42cb2153-0838-4383-8a70-5e43513ee8e4'} {{(pid=95125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:08:08.188805 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:08:08.192810 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [None req-42cb2153-0838-4383-8a70-5e43513ee8e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11afc4d3c62b4f83a9af8f5375b18add', 'request_id': 'req-42cb2153-0838-4383-8a70-5e43513ee8e4'} {{(pid=95125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:08:08.199533 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [None req-42cb2153-0838-4383-8a70-5e43513ee8e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11afc4d3c62b4f83a9af8f5375b18add', 'request_id': 'req-42cb2153-0838-4383-8a70-5e43513ee8e4'} {{(pid=95125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:08:08.280954 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [None req-42cb2153-0838-4383-8a70-5e43513ee8e4 admin admin] The token cache is being invalidate because project 11afc4d3c62b4f83a9af8f5375b18add was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 01:08:08.281212 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [None req-42cb2153-0838-4383-8a70-5e43513ee8e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:08:08.281870 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [None req-42cb2153-0838-4383-8a70-5e43513ee8e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:08:08.283357 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 630/1253] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 01:08:08 2022] DELETE /identity/v3/projects/11afc4d3c62b4f83a9af8f5375b18add => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:08:08.287383 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8474f-0c97-4d1f-878b-ca771a898d57 admin admin] Authenticating user token {{(pid=95124) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:08:08.288779 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.fernet_utils [None req-89f8474f-0c97-4d1f-878b-ca771a898d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95124) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:08:08.302063 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8474f-0c97-4d1f-878b-ca771a898d57 admin admin] Validating token access rules against request {{(pid=95124) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:08:08.359984 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c56f69-641b-469f-b877-52f1e7c8d606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95124) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:08:08.360685 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c56f69-641b-469f-b877-52f1e7c8d606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:08:08.360890 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c56f69-641b-469f-b877-52f1e7c8d606 admin admin] SCRIPT_NAME: `/identity` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:08:08.361170 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c56f69-641b-469f-b877-52f1e7c8d606 admin admin] PATH_INFO: `/v3/users/30da4a0a6371411b8a6b60791ff88416` {{(pid=95124) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:08:08.362339 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c56f69-641b-469f-b877-52f1e7c8d606 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30da4a0a6371411b8a6b60791ff88416)` {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:08:08.364272 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c56f69-641b-469f-b877-52f1e7c8d606 admin admin] RBAC: Authorization granted {{(pid=95124) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:08:08.535206 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [None req-b3c56f69-641b-469f-b877-52f1e7c8d606 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30da4a0a6371411b8a6b60791ff88416'} {{(pid=95124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:08:08.542378 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [None req-b3c56f69-641b-469f-b877-52f1e7c8d606 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30da4a0a6371411b8a6b60791ff88416'} {{(pid=95124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:08:08.554655 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [None req-b3c56f69-641b-469f-b877-52f1e7c8d606 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30da4a0a6371411b8a6b60791ff88416'} {{(pid=95124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:08:08.555407 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [None req-b3c56f69-641b-469f-b877-52f1e7c8d606 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30da4a0a6371411b8a6b60791ff88416'} {{(pid=95124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:08:08.557318 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:08:08.661474 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG keystone.notifications [None req-b3c56f69-641b-469f-b877-52f1e7c8d606 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30da4a0a6371411b8a6b60791ff88416'} {{(pid=95124) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:08:08.667905 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: [pid: 95124|app: 0|req: 624/1254] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 26 01:08:08 2022] DELETE /identity/v3/users/30da4a0a6371411b8a6b60791ff88416 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:08:08.934501 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb2153-0838-4383-8a70-5e43513ee8e4 admin admin] Authenticating user token {{(pid=95125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:08:08.936590 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.fernet_utils [None req-42cb2153-0838-4383-8a70-5e43513ee8e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=95125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:08:08.949806 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb2153-0838-4383-8a70-5e43513ee8e4 admin admin] Validating token access rules against request {{(pid=95125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:08:09.010636 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7643f-93a9-4027-bb68-0eb4c9752de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a681f7ed1c9344b28a9297878afcbf46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd490d60fce834824a5c1595cbd7a1ebe', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=95125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:08:09.011292 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7643f-93a9-4027-bb68-0eb4c9752de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:08:09.011590 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7643f-93a9-4027-bb68-0eb4c9752de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:08:09.011884 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7643f-93a9-4027-bb68-0eb4c9752de8 admin admin] PATH_INFO: `/v3/projects/53a464e8da814116a60eea81edd1e1ac` {{(pid=95125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:08:09.013098 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7643f-93a9-4027-bb68-0eb4c9752de8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53a464e8da814116a60eea81edd1e1ac)` {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:08:09.015054 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7643f-93a9-4027-bb68-0eb4c9752de8 admin admin] RBAC: Authorization granted {{(pid=95125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:08:09.115544 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [None req-9cb7643f-93a9-4027-bb68-0eb4c9752de8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53a464e8da814116a60eea81edd1e1ac', 'request_id': 'req-9cb7643f-93a9-4027-bb68-0eb4c9752de8'} {{(pid=95125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:08:09.121216 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [None req-9cb7643f-93a9-4027-bb68-0eb4c9752de8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53a464e8da814116a60eea81edd1e1ac', 'request_id': 'req-9cb7643f-93a9-4027-bb68-0eb4c9752de8'} {{(pid=95125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:08:09.127965 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [None req-9cb7643f-93a9-4027-bb68-0eb4c9752de8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53a464e8da814116a60eea81edd1e1ac', 'request_id': 'req-9cb7643f-93a9-4027-bb68-0eb4c9752de8'} {{(pid=95125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:08:09.209145 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [None req-9cb7643f-93a9-4027-bb68-0eb4c9752de8 admin admin] The token cache is being invalidate because project 53a464e8da814116a60eea81edd1e1ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=95125) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 01:08:09.209548 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [None req-9cb7643f-93a9-4027-bb68-0eb4c9752de8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:08:09.210179 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG keystone.notifications [None req-9cb7643f-93a9-4027-bb68-0eb4c9752de8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=95125) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:08:09.211678 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: [pid: 95125|app: 0|req: 631/1255] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 26 01:08:08 2022] DELETE /identity/v3/projects/53a464e8da814116a60eea81edd1e1ac => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:08:18.720089 dv-osbrick-786733-10-ceph devstack@keystone.service[95124]: DEBUG dbcounter [-] [95124] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=95124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:08:19.205998 dv-osbrick-786733-10-ceph devstack@keystone.service[95125]: DEBUG dbcounter [-] [95125] Writing DB stats keystone:SELECT=57,keystone:DELETE=9,keystone:INSERT=2 {{(pid=95125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}